This website requires JavaScript.

Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspective

Steven Euijong WhangYuji RohHwanjun SongJae-Gil Lee
摘要
Software 2.0 is a fundamental shift in software engineering where machinelearning becomes the new software, powered by big data and computinginfrastructure. As a result, software engineering needs to be re-thought wheredata becomes a first-class citizen on par with code. One striking observationis that 80-90% of the machine learning process is spent on data preparation.Without good data, even the best machine learning algorithms cannot performwell. As a result, data-centric AI practices are now becoming mainstream.Unfortunately, many datasets in the real world are small, dirty, biased, andeven poisoned. In this survey, we study the research landscape for datacollection and data quality primarily for deep learning applications. Datacollection is important because there is lesser need for feature engineeringfor recent deep learning approaches, but instead more need for large amounts ofdata. For data quality, we study data validation and data cleaning techniques.Even if the data cannot be fully cleaned, we can still cope with imperfect dataduring model training where using robust model training techniques. Inaddition, while bias and fairness have been less studied in traditional datamanagement research, these issues become essential topics in modern machinelearning applications. We thus study fairness measures and unfairnessmitigation techniques that can be applied before, during, or after modeltraining. We believe that the data management community is well poised to solveproblems in these directions.
展开全部
图表提取

暂无人提供速读十问回答

论文十问由沈向洋博士提出,鼓励大家带着这十个问题去阅读论文,用有用的信息构建认知模型。写出自己的十问回答,还有机会在当前页面展示哦。

Q1论文试图解决什么问题?
Q2这是否是一个新的问题?
Q3这篇文章要验证一个什么科学假设?
0
被引用
笔记
问答