This session explains the history of the evolution and current status of the data infrastructure of ZOZO TOWN and various issues that we encountered in the process of expanding it and how we have overcome them.
The current ZOZO TOWN data infrastructure is used by about half of all employees, but at first, it was only used by a dozen people. With the increase of users, we had a growing number of data inconsistency problems. The number of inquiries about inconsistencies between the data in the DB from which data was acquired and the data in the data infrastructure was increasing day by day, and both users and developers were exhausted. Failures (including aborted failures) caused by data inconsistency occurred as well. The cause of this problem was one technical mistake made in the earliest stage of building the data infrastructure. It was the acquisition of data from a data source that seemed to have assured quality, but actually, it did not. Therefore, we acquired data from a data source whose quality was assured and rebuilt the data infrastructure. As a result, data quality improved and inquiries about data inconsistencies were eliminated.
