I think this is a bug

blub_smile · Sep 13th 2016

Hi

I tried to recompress some data in my archive from J2K lossless to NKI N4 and encountered some error.

Here is what/ how I did it and how to reproduce it:

Use Conquest 1.4.17d or 1.4.19b3b and have some files with J2K lossless in your data directory. Then simply change compression for Conquest to NKI and drag-n-drop your data folder to the GUI - it starts recursively scanning the data and re-compresses it to NKI.

This process works flawlessly for any CT/MRI image I have tested (about 6k) but fails for CR/DX images after a couple of successful recompresses.
The original files or OK and when I drop them to the GUI to an empty Conquest setup (still set to NKI) they all compress just fine - its just the recompress that fails.

Setup uses MySQL and I have tried it with different HDDs and partitions (HDD and SSD)

So here is a debug log, maybe that helps:

Code

13.09.2016 08:32:40 ---- Processing directory: C:\0comptest\converttest\CR\2007\07\12477\1.2.392.200036.9125.2.8116652170.64526765062.1228181\1.2.392.200036.9125.3.8116652170.64526765066.1228183
13.09.2016 08:32:42 [CONVERT] Connected by address: 0100007f
13.09.2016 08:32:42 [CONVERT] Testing transfer: '1.2.840.10008.1.2' against list #0 = '1.2.840.10008.1.2'
13.09.2016 08:32:42 [CONVERT] 0000,0002     18 UI AffectedSOPClassUID    "1.2.840.10008.1.1" 
13.09.2016 08:32:42 [CONVERT] 0000,0100      2 US CommandField           48 
13.09.2016 08:32:42 [CONVERT] 0000,0110      2 US MessageID              7 
13.09.2016 08:32:42 [CONVERT] 0000,0800      2 US DataSetType            257 
13.09.2016 08:32:42 [CONVERT] 0002,0010     17 UI TransferSyntaxUID      "1.2.840.10008.1.2" 
13.09.2016 08:32:42 [CONVERT] 9999,0400    172 LO ConquestConsoleComma   "addimagefile:C:\\0comptest\\converttest\\CR\\2007\\07\\12477\\1.2.392.200036.9125.2.8116652170.64526765062.1228181\\1.2.392.200036.9125.3.8116652170.64526765066.1228183\\001001.dcm" 
13.09.2016 08:32:42 [CONVERT] Jasper decompress started.
13.09.2016 08:32:42 [CONVERT] Jasper library init completed.
13.09.2016 08:32:42 [CONVERT] Info[DecompressJPEG2K] stream_len = 33559200, frames = 1, total_len = 33559200, prec = 10,cps_jas = 2.
13.09.2016 08:32:42 [CONVERT] Jasper decompress time 2 seconds.
13.09.2016 08:32:42 [CONVERT] [recompress]: recompressed with mode = n4 (strip=1)
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMImages
13.09.2016 08:32:42 [CONVERT] Columns     : ObjectFile, DeviceName
13.09.2016 08:32:42 [CONVERT] Where       : SOPInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' AND ImagePat = '12477'
13.09.2016 08:32:42 [CONVERT] Order       : (null)
13.09.2016 08:32:42 [CONVERT] Query On Image
13.09.2016 08:32:42 [CONVERT] Issue Query on Columns: DICOMImages.SOPInstanc, DICOMSeries.SeriesInst, DICOMStudies.PatientID, DICOMStudies.StudyInsta
13.09.2016 08:32:42 [CONVERT] Values: DICOMImages.SOPInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' and DICOMStudies.PatientID = '12477' and DICOMSeries.StudyInsta = DICOMStudies.StudyInsta and DICOMImages.SeriesInst = DICOMSeries.SeriesInst
13.09.2016 08:32:42 [CONVERT] Tables: DICOMImages, DICOMSeries, DICOMStudies
13.09.2016 08:32:42 [CONVERT] Query Distinct Tables: DICOMImages, DICOMSeries, DICOMStudies
13.09.2016 08:32:42 [CONVERT] Columns              : DICOMImages.SOPInstanc, DICOMSeries.SeriesInst, DICOMStudies.PatientID, DICOMStudies.StudyInsta
13.09.2016 08:32:42 [CONVERT] Where                : DICOMImages.SOPInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' and DICOMStudies.PatientID = '12477' and DICOMSeries.StudyInsta = DICOMStudies.StudyInsta and DICOMImages.SeriesInst = DICOMSeries.SeriesInst
13.09.2016 08:32:42 [CONVERT] Order                : (null)
13.09.2016 08:32:42 [CONVERT] Records = 1
13.09.2016 08:32:42 [CONVERT] RemoveFromPACS 1 images
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMImages
13.09.2016 08:32:42 [CONVERT] Columns     : ObjectFile, DeviceName
13.09.2016 08:32:42 [CONVERT] Where       : SOPInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' AND ImagePat = '12477'
13.09.2016 08:32:42 [CONVERT] Order       : (null)
13.09.2016 08:32:42 [CONVERT] Removed file: [MAG0:CR\2007\07\12477\1.2.392.200036.9125.2.8116652170.64526765062.1228181\1.2.392.200036.9125.3.8116652170.64526765066.1228183\001001.dcm]
13.09.2016 08:32:42 [CONVERT] IOD File being removed: C:\0comptest\converttest\CR\2007\07\12477\1.2.392.200036.9125.2.8116652170.64526765062.1228181\1.2.392.200036.9125.3.8116652170.64526765066.1228183\001001.dcm
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMImages
13.09.2016 08:32:42 [CONVERT] Columns     : DICOMImages.SopInstanc
13.09.2016 08:32:42 [CONVERT] Where       : DICOMImages.SopInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' and DICOMImages.SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' and DICOMImages.ImagePat = '12477'
13.09.2016 08:32:42 [CONVERT] Order       : (null)
13.09.2016 08:32:42 [CONVERT] Delete Record Table: DICOMImages
13.09.2016 08:32:42 [CONVERT] Where              : DICOMImages.SopInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' and DICOMImages.SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' and DICOMImages.ImagePat = '12477'
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMImages
13.09.2016 08:32:42 [CONVERT] Columns     : DICOMImages.SeriesInst
13.09.2016 08:32:42 [CONVERT] Where       : DICOMImages.SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' and DICOMImages.ImagePat = '12477'
13.09.2016 08:32:42 [CONVERT] Order       : (null)
13.09.2016 08:32:42 [CONVERT] Delete Record Table: DICOMSeries
13.09.2016 08:32:42 [CONVERT] Where              : DICOMSeries.SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' and DICOMSeries.StudyInsta = '1.2.392.200036.9125.2.8116652170.64526765062.1228181' and DICOMSeries.SeriesPat = '12477'
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMSeries
13.09.2016 08:32:42 [CONVERT] Columns     : DICOMSeries.StudyInsta
13.09.2016 08:32:42 [CONVERT] Where       : DICOMSeries.StudyInsta = '1.2.392.200036.9125.2.8116652170.64526765062.1228181' and DICOMSeries.SeriesPat = '12477'
13.09.2016 08:32:42 [CONVERT] Order       : (null)
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMStudies
13.09.2016 08:32:42 [CONVERT] Columns     : DICOMStudies.PatientID
13.09.2016 08:32:42 [CONVERT] Where       : DICOMStudies.PatientID = '12477'
13.09.2016 08:32:42 [CONVERT] Order       : (null)
13.09.2016 08:32:42 [CONVERT] FreeStore Left 14148 on C:\
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMImages
13.09.2016 08:32:42 [CONVERT] Columns     : SOPInstanc,SOPClassUI,ImageNumbe,ImageDate,ImageTime,EchoNumber,NumberOfFr,AcqDate,AcqTime,ReceivingC,AcqNumber,SliceLocat,SamplesPer,PhotoMetri,Rows,Colums,BitsStored,ImageType,ImageID,ImagePat,SeriesInst
13.09.2016 08:32:42 [CONVERT] Where       : SOPInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' AND ImagePat = '12477'
13.09.2016 08:32:42 [CONVERT] Order       : (null)
13.09.2016 08:32:42 [CONVERT] Add to Table: DICOMImages
13.09.2016 08:32:42 [CONVERT] Columns: SOPInstanc, SOPClassUI, ImageNumbe, ImageDate, ImageTime, AcqDate, AcqTime, AcqNumber, SamplesPer, PhotoMetri, Rows, Colums, BitsStored, ImageType, ImagePat, SeriesInst, AccessTime, ObjectFile, DeviceName
13.09.2016 08:32:42 [CONVERT] Values: '1.2.392.200036.9125.9.0.252046875.3456106688.756091448', '1.2.840.10008.5.1.4.1.1.1', '1001', '20070716', '132429.062', '20070716', '132429.062', '080', '1', 'MONOCHROME1', '4740', '3540', '10', 'DERIVED\\PRIMARY\\POST_PROCESSED', '12477', '1.2.392.200036.9125.3.8116652170.64526765066.1228183', 1473748352, 'CR\\2007\\07\\12477\\1.2.392.200036.9125.2.8116652170.64526765062.1228181\\1.2.392.200036.9125.3.8116652170.64526765066.1228183\\001001.v2', 'MAG0'
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMSeries
13.09.2016 08:32:42 [CONVERT] Columns     : SeriesInst,SeriesNumb,SeriesDate,SeriesTime,SeriesDesc,Modality,PatientPos,ContrastBo,Manufactur,ModelName,BodyPartEx,ProtocolNa,StationNam,Institutio,FrameOfRef,SeriesPat,StudyInsta
13.09.2016 08:32:42 [CONVERT] Where       : SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' AND SeriesPat = '12477'
13.09.2016 08:32:42 [CONVERT] Order       : (null)
13.09.2016 08:32:42 [CONVERT] Add to Table: DICOMSeries
13.09.2016 08:32:42 [CONVERT] Columns: SeriesInst, SeriesNumb, SeriesDate, SeriesTime, Modality, Manufactur, ModelName, BodyPartEx, StationNam, Institutio, SeriesPat, StudyInsta, AccessTime
13.09.2016 08:32:42 [CONVERT] Values: '1.2.392.200036.9125.3.8116652170.64526765066.1228183', '1001', '20070716', '132429.000', 'CR', 'FUJI PHOTO FILM Co., ltd.', '5000MA', 'BREAST', 'fcr5000ma', 'XXXXX', 'XXXX', '1.2.392.200036.9125.2.8116652170.64526765062.1228181', 1473748352
13.09.2016 08:32:42 [CONVERT] Query Tables: DICOMStudies
13.09.2016 08:32:42 [CONVERT] Columns     : StudyInsta,StudyDate,StudyTime,StudyID,StudyDescr,AccessionN,ReferPhysi,PatientsAg,PatientsWe,StudyModal,PatientNam,PatientBir,PatientSex,PatientID
13.09.2016 08:32:43 [CONVERT] Where       : StudyInsta = '1.2.392.200036.9125.2.8116652170.64526765062.1228181'
13.09.2016 08:32:43 [CONVERT] Order       : (null)
13.09.2016 08:32:43 [CONVERT] Update Table: DICOMStudies
13.09.2016 08:32:43 [CONVERT] Updates     :  StudyInsta = '1.2.392.200036.9125.2.8116652170.64526765062.1228181',  StudyDate = '20070716',  StudyTime = '132422.000',  AccessionN = '12477',  StudyModal = 'CR',  PatientNam = 'Velte ^Dagmar',  PatientBir = '19591002',  PatientSex = 'F',  PatientID = '12477', AccessTime = 1473748352
13.09.2016 08:32:43 [CONVERT] Where       : StudyInsta = '1.2.392.200036.9125.2.8116652170.64526765062.1228181'
13.09.2016 08:32:43 [CONVERT] Query Tables: DICOMPatients
13.09.2016 08:32:43 [CONVERT] Columns     : PatientID,PatientNam,PatientBir,PatientSex
13.09.2016 08:32:43 [CONVERT] Where       : PatientID = '12477'
13.09.2016 08:32:43 [CONVERT] Order       : (null)
13.09.2016 08:32:43 [CONVERT] Update Table: DICOMPatients
13.09.2016 08:32:43 [CONVERT] Updates     :  PatientID = '12477',  PatientNam = XXXX',  PatientBir = 'XXXXX',  PatientSex = 'X', AccessTime = 1473748352
13.09.2016 08:32:43 [CONVERT] Where       : PatientID = '12477'
13.09.2016 08:32:43 [CONVERT] ***Error writing file: C:\0comptest\converttest\CR\2007\07\12477\1.2.392.200036.9125.2.8116652170.64526765062.1228181\1.2.392.200036.9125.3.8116652170.64526765066.1228183\001001.v2
13.09.2016 08:32:43 [CONVERT] Query Tables: DICOMImages
13.09.2016 08:32:43 [CONVERT] Columns     : DICOMImages.SopInstanc
13.09.2016 08:32:43 [CONVERT] Where       : DICOMImages.SopInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' and DICOMImages.SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' and DICOMImages.ImagePat = '12477'
13.09.2016 08:32:43 [CONVERT] Order       : (null)
13.09.2016 08:32:43 [CONVERT] Delete Record Table: DICOMImages
13.09.2016 08:32:43 [CONVERT] Where              : DICOMImages.SopInstanc = '1.2.392.200036.9125.9.0.252046875.3456106688.756091448' and DICOMImages.SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' and DICOMImages.ImagePat = '12477'
13.09.2016 08:32:43 [CONVERT] Query Tables: DICOMImages
13.09.2016 08:32:43 [CONVERT] Columns     : DICOMImages.SeriesInst
13.09.2016 08:32:43 [CONVERT] Where       : DICOMImages.SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' and DICOMImages.ImagePat = '12477'
13.09.2016 08:32:43 [CONVERT] Order       : (null)
13.09.2016 08:32:43 [CONVERT] Delete Record Table: DICOMSeries
13.09.2016 08:32:43 [CONVERT] Where              : DICOMSeries.SeriesInst = '1.2.392.200036.9125.3.8116652170.64526765066.1228183' and DICOMSeries.StudyInsta = '1.2.392.200036.9125.2.8116652170.64526765062.1228181' and DICOMSeries.SeriesPat = '12477'
13.09.2016 08:32:43 [CONVERT] Query Tables: DICOMSeries
13.09.2016 08:32:43 [CONVERT] Columns     : DICOMSeries.StudyInsta
13.09.2016 08:32:43 [CONVERT] Where       : DICOMSeries.StudyInsta = '1.2.392.200036.9125.2.8116652170.64526765062.1228181' and DICOMSeries.SeriesPat = '12477'
13.09.2016 08:32:43 [CONVERT] Order       : (null)
13.09.2016 08:32:43 [CONVERT] Query Tables: DICOMStudies
13.09.2016 08:32:43 [CONVERT] Columns     : DICOMStudies.PatientID
13.09.2016 08:32:43 [CONVERT] Where       : DICOMStudies.PatientID = '12477'
13.09.2016 08:32:43 [CONVERT] Order       : (null)
13.09.2016 08:32:43 [CONVERT] ***[AddImageFile] Error entering object into server: C:\0comptest\converttest\CR\2007\07\12477\1.2.392.200036.9125.2.8116652170.64526765062.1228181\1.2.392.200036.9125.3.8116652170.64526765066.1228183\001001.dcm
13.09.2016 08:32:43 ---- Processing directory: C:\0comptest\converttest\CR\2007\07\12477\1.2.392.200036.9125.2.8116652170.64526765062.1228181\1.2.392.200036.9125.3.8116652170.64526765066.1228184
13

Display More

marcelvanherk · Sep 13th 2016

Hi,

I would not advise this workflow - but I am curious what goes wrong. Could you try with a few source compressions other than jpeg2000?

Marcel

blub_smile · Sep 13th 2016

Quote from marcelvanherk

Hi,

I would not advise this workflow - but I am curious what goes wrong. Could you try with a few source compressions other than jpeg2000?

Marcel

Hi, I will try something different tonight. I once re-compressed the entire archive this way to jpeg2000 lossless and it worked perfectly..

blub_smile · Sep 13th 2016

High Marcel,

in another thread you posted:
"
Re: Compress Old Images

Postby marcelvanherk » Wed Aug 24, 2016 12:50 pm
Hi,

Change the receiving compression and send the images to itself.

Marcel
"

But isn't drag-n-frop the archive folder exactly the same thing as sending the image to itself?

marcelvanherk · Sep 13th 2016

Hi,

the difference is that read and write are done by different processes, and apparently interfere, but I am not sure how.

Marcel

blub_smile · Sep 13th 2016

HI

mhh ok. I haven't decided which way to with compression yet anyway and sending data to itself via GUI also works fine - although it is quite a lot more work since drag_n-drop would only be a one time task (sending 50M images in one chunk is probably not a good idea for neither conquest nor database )

PS: It also happens with other compressions - so from NKI to JPEG i.e.

I think this is a bug

Participate now!

Share