![]() ![]() The simple SQL statements purpose was to both create a new database table to hold the CSV file data, and then to also insert the data directly into that new database table. ![]() The csv2sql tool was created to quickly integrity check the source CSV file, report on its size (simple stats), and convert it into a text file that contained simple SQL statements. Having simple tools to improve the work flow, and produce consistent repeatable results was very important! The work often required a quick turn around-so any tools that could provide increased efficiency, but still maintain integrity (or even increase the integrity checking) became key. The different data sources (starting as CSV files-as data was extracted from business systems by a different team) would be loaded into an ad-hoc SQLite database as tables, and then analysed with the benefit of SQL, and sometimes in later stages, through the use of scripts-mainly on the more complex projects. The data was used for ad-hoc revenue assurance investigations and analysis, to aide recovery processes, and often in reporting for the associated wider projects. The data would vary quite a bit, often being sourced from multiple financial, audit, billing and business support corporate computer systems-so there was no consistency in the CSV file formats provided, from project to project. The program was originally created to speed up the process of checking and then importing large (often greater than 1GB) CSV files into SQLite databases. Csv2sql is a small simple program specifically designed to quickly convert a comma separated value (CSV) file into simple structured query language (SQL) statements, which can then be used as an import source for a SQLite database.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |