DevilKing's blog

冷灯看剑,剑上几分功名?炉香无需计苍生,纵一穿烟逝,万丈云埋,孤阳还照古陵

0%

Data validation for machine learning

原文链接

The data validation stage has three main components:

  • the data analyzer computes statistics over the new data batch
  • the data validator checks properties of the data against a schema
  • the model unit tester looks for errors in the training code using synthetic data (schema-led fuzzing)

detecting skew