Input data storage
Interim input data can be stored as text, CSV or XML files, Excel spreadsheets or sandbox databases. For consistency, it is preferable to keep input data in the “Data” folder of the corresponding project folder. When the data is intended for use by other people, it is helpful to use a single format that can be easily picked up and converted into a form convenient for its consumer. For most practical purposes, CSV is preferred. If the data is stored in a sandbox database, SQL scripts used for data extraction can be stored in the “Code” folder of the project. If the creation of a shared internal database is desirable and possible for the purpose of the project, it can be set up on the common server with tables named for specific tasks.