[dscng-dev] Error reading corrupt dat files

Bedrich Kosata bedrich.kosata at nic.cz
Fri Jun 15 13:51:07 CEST 2012


Hi John,

On 06/15/2012 01:11 PM, John Dickinson wrote:
>
> Now running the latest code from git. Seems OK so far.
>
> I do have another error
>
> in a pcap_stats.dat file there is a line containing only
>
> ter_received eth0:477
>
> the start of the line is missing. It gives this error:
>
> Import was unsuccessful - error: 'ter_received'
> Traceback:
>    File "/home/jad/src/dscng/import_dsc_dat_files.py", line 1434, in import_dirs
>      importer.import_data_dir(fullname)
>    File "/home/jad/src/dscng/import_dsc_dat_files.py", line 433, in import_data_dir
>      content, sha1sum, dirname)
>    File "/home/jad/src/dscng/import_dsc_dat_files.py", line 659, in process_minute_type
>      dims[1])
>    File "/home/jad/src/dscng/import_dsc_dat_files.py", line 783, in parse_data_file_3d
>      rec_dt = self._time_map[data[0]]
>
> regards
> John
>

It seems that there is a lot of corrupted data in your case. It seems 
that I need to put some work into a more robust way of handling imported 
data.
Could you please send me the corrupted file (or a part), so that I can 
use it for testing?

Best regards

Beda

>
> ---
> jad at sinodun.com
>
> http://sinodun.com
>
> Sinodun Internet Technologies Ltd.
> Stables 4, Suite 11,
> Howbery Park,
> Wallingford,
> Oxfordshire,
> OX10 8BA,
> U.K.
>
> +44 (0)1491 834957
>

-- 
Bedrich Kosata
CZ.NIC Labs <http://labs.nic.cz>


More information about the dscng-dev mailing list