These files have a definite format - a header, body and footer. All blocks have some or the data to capture. Tried pre-processing and consolidation using Unix shell script, however parsing logic is pretty complex and has an adverse affect on CPU.
Data from these files need to be loaded to separate tables.
↧