CSV File Format
We all know that we should be writing file extracts as XML but if we really need to get a CSV file then here is how to do it Introduction Comma Separated Values (CSV) files have…
Read MoreTag: ETL
Data Transformation – Procedural & Non Procedural Solutions
This paper looks at a somewhat awkward data transformation, and at solutions written in SQL and in a procedural language. It describes some techniques which can be used to develop the solution in both languages. It…
Read MoreBasic Data Quality Checks
This article looks at basic data quality audit that can be done within a database. Examples are given using Oracle syntax however the techniques can also be applied to other databases Introduction The following article…
Read MoreDetecting Changed Data
Introduction When loading data warehouses, it is usually possible to decreases the load time very significantly by processing only changes since the last load, rather than completely refreshing all the data every time. This article describes…
Read MoreJob scheduling – fixed and relative timing
This article looks at the relatve merits of two types of processing schedule, once based on a fixed times (similar to ‘cron’ on a unix system) and onebased on relative times (similar to ‘at’ on a…
Read More