Problem written bigendian mammo images

CODY57 · Nov 13th 2014

Hello Marcel,

I've got one another problem with my new conquest server.
the physician can't retreive some images(MG)from KPACS:

Code

DSASRV1] UPACS THREAD 116: STARTED AT: Thu Nov 13 16:32:32 2014[DSASRV1] A-ASSOCIATE-RQ Packet Dump[DSASRV1]  Calling Application Title : "KPS"[DSASRV1]  Called Application Title : "DSASRV1         "[DSASRV1]  Application Context : "1.2.840.10008.3.1.1.1", PDU length: 16384[DSASRV1]  Number of Proposed Presentation Contexts: 1[DSASRV1]  Presentation Context 0 "1.2.840.10008.5.1.4.1.2.2.2" 1[DSASRV1] Server Command   := 0021[DSASRV1] Message ID       := 0003[DSASRV1]  C-Move Destination: "KPS"[DSASRV1] Records = 4[DSASRV1] Number of Images to send: 4[DSASRV1] MyStudyRootRetrieveGeneric :: RetrieveOn[DSASRV1] Locating file:MAG0 779117217\1.2.840.113619.2.66.2216950631.7936141104090308.10005_167257_000001_14150887820929.dcm[DSASRV1] Locating file:MAG0 779117217\1.2.840.113619.2.66.2216950631.7936141104090308.10005_167257_000002_1415088789092b.dcm[DSASRV1] Locating file:MAG0 779117217\1.2.840.113619.2.66.2216950631.7936141104090308.10005_167257_000003_1415088795092c.dcm[DSASRV1] Locating file:MAG0 779117217\1.2.840.113619.2.66.2216950631.7936141104090308.10005_167257_000004_14150887750928.dcm[DSASRV1] ReadAheadThread: readahead > 0000[DSASRV1] RetrieveOn: givenout < 0000[DSASRV1] Sending file : E:\imagesdicom1\779117217\1.2.840.113619.2.66.2216950631.7936141104090308.10005_167257_000001_14150887820929.dcm[DSASRV1] Image Loaded from Read Ahead Thread, returning TRUE[DSASRV1] Retrieve: remote connection dropped after 0 images, 4 not sent[DSASRV1] C-Move (StudyRoot)[DSASRV1] UPACS THREAD 116: ENDED AT: Thu Nov 13 16:32:35 2014[DSASRV1] UPACS THREAD 116: TOTAL RUNNING TIME: 3 SECONDS

Images was stored succesfully :

Code

04/11/2014 09:13:01 [DSASRV1] UPACS THREAD 7785: STARTED AT: Tue Nov 04 09:13:00 201404/11/2014 09:13:01 [DSASRV1]  Calling Application Title : "aws             "04/11/2014 09:13:01 [DSASRV1]  Called Application Title : "DSASRV1         "04/11/2014 09:13:01 [DSASRV1]  Application Context : "1.2.840.10008.3.1.1.1", PDU length: 2867204/11/2014 09:13:01 [DSASRV1]  Presentation Context 0 "1.2.840.10008.5.1.4.1.1.1" 104/11/2014 09:13:01 [DSASRV1]  Presentation Context 1 "1.2.840.10008.5.1.4.1.1.7" 104/11/2014 09:13:01 [DSASRV1]  Presentation Context 2 "1.2.840.10008.5.1.4.1.1.1.2" 104/11/2014 09:13:01 [DSASRV1]  Presentation Context 3 "1.2.840.10008.5.1.4.1.1.1.2.1" 104/11/2014 09:13:01 [DSASRV1]  Presentation Context 4 "1.2.840.10008.5.1.4.1.1.1.1" 104/11/2014 09:13:01 [DSASRV1]  Presentation Context 5 "1.2.840.10008.5.1.4.1.1.1.1.1" 104/11/2014 09:13:01 [DSASRV1]  Presentation Context 6 "1.2.840.10008.5.1.4.1.1.88.50" 104/11/2014 09:13:01 [DSASRV1]  Presentation Context 7 "1.2.840.10008.5.1.4.1.1.88.22" 104/11/2014 09:13:02 [DSASRV1] Written file: E:\imagesdicom1\779117217\1.2.840.113619.2.66.2216950631.7936141104090308.10005_167257_000001_14150887820929.dcm04/11/2014 09:13:02 [DSASRV1] UPACS THREAD 7785: ENDED AT: Tue Nov 04 09:13:02 201404/11/2014 09:13:02 [DSASRV1] UPACS THREAD 7785: TOTAL RUNNING TIME: 2 SECONDS

So I try to drag and drop the image to the conquest user interface and I received this error:

Code

----------- Adding image files to server -----------
[DSASRV1] 0000,0002     18 UI AffectedSOPClassUID    "1.2.840.10008.1.1" 
[DSASRV1] 0000,0100      2 US CommandField           48 
[DSASRV1] 0000,0110      2 US MessageID              7 
[DSASRV1] 0000,0800      2 US DataSetType            257 
[DSASRV1] 0002,0010     17 UI TransferSyntaxUID      "1.2.840.10008.1.2" 
[DSASRV1] 9999,0400    158 LO ConquestConsoleComma   "addimagefile:C:\\Users\\Administrateur\\Desktop\\Nouveau dossier\\779117217\\1.2.840.113619.2.66.2216950631.7936141104090308.10005_167257_000001_14150887820929.dcm" 
[DSASRV1] ***[AddImageFile] C:\Users\Administrateur\Desktop\Nouveau dossier\779117217\1.2.840.113619.2.66.2216950631.7936141104090308.10005_167257_000001_14150887820929.dcm -FAILED: file does not contain correct UIDs
-----------------------------------------------------

But I can open this file directly with KPACS!
I can send some images if you want to test.

Thanks,
Jean-Christophe

marcelvanherk · Nov 13th 2014

Hi Jean,

it looks like the images were curropted. How big are they after recieved by conquest. The one you dropped, where did it come from?

Marcel

CODY57 · Nov 14th 2014

Quote from marcelvanherk

Hi Jean,

it looks like the images were curropted. How big are they after recieved by conquest. The one you dropped, where did it come from?

Marcel

Hi Marcel,

The file is 8588Ko big(same size as a good file),it came from a GE mammograph ,the problem is that I don't have any error in conquest error log.
I try to reproduce the problem on my laptop ,but I can't import it in conquest(Kpacs can open the file....).
Do you think it could be a network problem during the transfer from GE to Conquest? I'm not sure that conquest accept corrupted data.

Jean-Christophe.

marcelvanherk · Nov 14th 2014

Hi,

one image (OK) states it uses explictlittleendian transfer and the other (broken) explictbigendian. How did you generate both images? What version are you using?

Marcel

CODY57 · Nov 15th 2014

Quote from marcelvanherk

Hi,

one image (OK) states it uses explictlittleendian transfer and the other (broken) explictbigendian. How did you generate both images? What version are you using?

Marcel

That's strange,the 2 images came from a GE Senographe Essential ADS_43.10.1.
I use Conquest 1.14.17d on a windows 2012 Server with mysql database.
I can't understand why images are stored correctly.

marcelvanherk · Nov 16th 2014

Hi,

what is in your dicom.ini?

Marcel

CODY57 · Nov 16th 2014

Quote from marcelvanherk

Hi,

what is in your dicom.ini?

Marcel

hi marcel,

Code

# This file contains configuration information for the DICOM server
# Do not edit unless you know what you are doing


[sscscp]
MicroPACS                = sscscp
Edition                  = Personal


# Network configuration: server name and TCP/IP port#
MyACRNema                = DSASRV1
TCPPort                  = 4096


# Reference to other files: known dicom servers; database layout; sops
ACRNemaMap               = acrnema.map
kFactorFile              = dicom.sql
SOPClassList             = dgatesop.lst


# Host, database, username and password for MySql database
SQLHost                  = localhost
SQLServer                = conquest
Username                 = root
Password                 = xxxxxxxxxx
MySql                    = 1
DoubleBackSlashToDB      = 1
UseEscapeStringConstants = 0


# Configure database
TruncateFieldNames       = 10
MaxFieldLength           = 254
MaxFileNameLength        = 255
FixPhilips               = 0
FixKodak                 = 0
KeepAlive                = 60
LargeFileSizeKB          = 4096
PrintSquareLandscape     = 0
UseKpacsDecompression    = 1
ZipTime                  = 05:
UIDPrefix                = 1.2.826.0.1.3680043.2.135.735462.50969925
EnableReadAheadThread    = 1
PatientQuerySortOrder    = 
StudyQuerySortOrder      = 
SeriesQuerySortOrder     = 
ImageQuerySortOrder      = 
EnableComputedFields     = 1
IndexDBF                 = 1
PackDBF                  = 0
LongQueryDBF             = 1000
TCPIPTimeOut             = 3000
FailHoldOff              = 60
RetryDelay               = 100
RetryForwardFailed       = 0
ImportExportDragAndDrop  = 0
QueueSize                = 128
WorkListMode             = 0
WorkListReturnsISO_IR_100 = 1
DebugLevel               = 4
Prefetcher               = 0
LRUSort                  = 
AllowTruncate            = 
DecompressNon16BitsJpeg  = 1
UseBuiltInJPEG           = 0
LossyQuality             = 95
IgnoreOutOfMemoryErrors  = 1
NoDICOMCheck             = 1
PadAEWithZeros           = 0
AllowEmptyPatientID      = 0
FileNameSyntax           = 4


# Configuration of compression for incoming images and archival
DroppedFileCompression   = uj
IncomingCompression      = uj
ArchiveCompression       = as


# Names of the database tables
PatientTableName         = DICOMPatients
StudyTableName           = DICOMStudies
SeriesTableName          = DICOMSeries
ImageTableName           = DICOMImages
WorkListTableName        = DICOMWorkList
DMarkTableName           = DICOMAccessUpdates
RegisteredMOPDeviceTable = RegisteredMOPIDs
UIDToMOPIDTable          = UIDToMOPID
UIDToCDRIDTable          = UIDToCDRID


# Banner and host for debug information
PACSName                 = DSASRV1
OperatorConsole          = 127.0.0.1


# Configure email of error messages
MailHost                 = 
MailPort                 = smtp
MailSignon               = 
MailFromName             = 
MailRcptName1            = 
MailCollectTime          = 1
MailWaitTime             = 10


# Configuration of disk(s) to store images
MAGDeviceThreshhold      = 0
MAGDeviceFullThreshHold  = 30
IgnoreMAGDeviceThreshold = 0
MAGDevices               = 1
MAGDevice0               = E:\imagesdicom1\
NightlyCleanThreshhold   = 0


# Configuration of the virtual server
VirtualServerFor         = 2
CacheVirtualData         = 0
OverlapVirtualGet        = 5
#VirtualServerFor0       = CON1
VirtualServerFor1        = DSASRV1BCK

Display More

thanks for your 24/7 support

Jean-christophe

marcelvanherk · Nov 16th 2014

No problem!

It may be an issue with UJ (uncompressed or jpeg). Was there maybe something changed on the sending side between both images?

Marcel

CODY57 · Nov 16th 2014

No, I don't think so.
I just made some test with compression factor(as asked for my other problem with fuji workstation).
Do you think it will be better if I only accept un for incoming images ?

Jean-Christophe

marcelvanherk · Nov 16th 2014

UJ is supposed to keep jpeg compressed images in their orginal compression. I have looked at the corrupted image again.

It states transfer syntax: 1.2.840.10008.1.2.2 (big endian explicit).

When loading with drag and drop you get:

CONQUESTSRV1] ***Dynamic_Parse encountered an invalid element length during load of DCM file (in ffffffff)
[CONQUESTSRV1] ***Length = 65535
[CONQUESTSRV1] ***Continuing parsing
[CONQUESTSRV1] ***(Dyn) Encountered an invalid group order during load of DCM file (after ffffffff)
[CONQUESTSRV1] ***[AddImageFile] C:\Users\marcel\Desktop\1.2.840.113619.2.66.2216950631.7936141104090301.10003_167256_000001_14150887570921.dcm -FAILED: Error on Load

When I use a hex editor and change the transfer syntax to : 1.2.840.10008.1.2.1 (little endian explicit).

It loads but tags show like:

(0028,0010) US 62984 # 2 Rows
(0028,0011) US 31239 # 2 Columns
(0028,0100) US 4096 # 2 BitsAllocated
(0028,0101) US 3584 # 2 BitsStored
(0028,0102) US 3328 # 2 HighBit

I.e. byte order reversed. So the image is partly encoded big endian and partly litlle endian. Have you by any change used compression 'UB' in the conquest system at all. It looks like this can be faulty (it is poorly tested in the server). Is it enabled in your dgatesop.lst? It should be disabled like this:

#BigEndianExplicit 1.2.840.10008.1.2.2 transfer

Marcel

CODY57 · Nov 19th 2014

Hi Marcel,

Thank's for all this informations.
I disable BigEndianExplicit transfer in the dgatesop.lst,and since " days,no more error with the mammography.
Did you know if it's possible to import again the corrupted images,because the GE technician deleted the database from the mammo workstation last week ... and all images are lost.

Thank's again for your help!

Jean-Christophe,

marcelvanherk · Nov 21st 2014

Hi Jean Cristophe,

how many images are effected?

Marcel

CODY57 · Nov 21st 2014

Hi Marcel,

I'll say 1 week, 10 patients per day, 4 to 6 images per patient, so approximately 200 images.

Jean-Christophe

marcelvanherk · Nov 21st 2014

If you can find a batch editor to do one string replace in a binary file, then they can be read.

After that we can script a fix program.

Marcel

CODY57 · Nov 21st 2014

I find a command line utility ,gsar:
http://gnuwin32.sourceforge.net/packages/gsar.htm
The syntax is realy simple:

Code

gsar -s:1.2.840.10008.1.2.2 -r1.2.840.10008.1.2.1 BAD.dcm GOOD.dcm

it will search in BAD.dcm for 1.2.840.10008.1.2.2 and replace by 1.2.840.10008.1.2.1 in a new file GOOD.dcm

Could that be a solution?

Jean-Christophe

marcelvanherk · Nov 22nd 2014

Hi Jean-Christophe,

yep, if you process the images I can write an importconverter that will swap the bytes in the affected tags. By the way, exactly what version of conquest was used to write the corrupted files? I can then warn users about this.

Marcel

CODY57 · Nov 22nd 2014

Hi,

It was conquest version 1. 4.17d release 2014/03/09.
Can you give me the tags that must be changed, so I can test it.

Jean-Christophe

marcelvanherk · Nov 22nd 2014

Hi,

it is everything of type US in the header. If you add this code to dicom.ini of a test server and enable ImportExportDragAndDrop (this is also in dicom.ini) then the following converters should fix the image. You can check this whether they show up in the browser after dropping them on the test server.

[lua]
ImportConverter0 = function swab(a) return math.floor(a/256)+256*(a%256) end
ImportConverter1 = Data.SamplesPerPixel = swab(Data.SamplesPerPixel)
ImportConverter2 = Data.Rows = swab(Data.Rows)
ImportConverter3 = Data.Columns = swab(Data.Columns)
ImportConverter4 = Data.BitsAllocated = swab(Data.BitsAllocated)
ImportConverter5 = Data.BitsStored = swab(Data.BitsStored)
ImportConverter6 = Data.HighBit = swab(Data.HighBit)
ImportConverter7 = Data.PixelRepresentation = swab(Data.PixelRepresentation)

I have not tested this!!

Marcel

CODY57 · Nov 22nd 2014

Hello Marcel,

The lua script works fine,but just with good images,when I try to drag and drop a faulty image,conquest don't wants to execute the script and reject the images.
her is a example:

Code

------------ Adding image files to server -----------
[CONQUESTSRV1] 0000,0002     18 UI AffectedSOPClassUID    "1.2.840.10008.1.1" 
[CONQUESTSRV1] 0000,0100      2 US CommandField           48 
[CONQUESTSRV1] 0000,0110      2 US MessageID              7 
[CONQUESTSRV1] 0000,0800      2 US DataSetType            257 
[CONQUESTSRV1] 0002,0010     17 UI TransferSyntaxUID      "1.2.840.10008.1.2" 
[CONQUESTSRV1] 9999,0400    152 LO ConquestConsoleComma   "addimagefile:C:\\Users\\fr031735\\Desktop\\20140110130guth\\original\\1.2.840.113619.2.66.2216950631.21381141113111852.10003_168061_000001_14158745230027.dcm" 
[CONQUESTSRV1] Importconverter-1.0 executes: set SamplesPerPixel to "256"
[CONQUESTSRV1] Importconverter-1.0 executes: set Rows to "62984"
[CONQUESTSRV1] Importconverter-1.0 executes: set Columns to "31239"
[CONQUESTSRV1] Importconverter-1.0 executes: set BitsAllocated to "4096"
[CONQUESTSRV1] Importconverter-1.0 executes: set BitsStored to "3584"
[CONQUESTSRV1] Importconverter-1.0 executes: set HighBit to "3328"
[CONQUESTSRV1] Importconverter-1.0 executes: set PixelRepresentation to "0"
[CONQUESTSRV1] Added file: D:\Siemens\Divers\Divers\Agfa\Outils Dicom\Logiciels serveur PACS\conquest\VERSION DE CONQUEST\dicomserver1417d\Data\77962135\1.2.840.113619.2.66.2216950631.21381141113111852.10003_168061_000001_14158861410001.dcm
-----------------------------------------------------
------------ Adding image files to server -----------
[CONQUESTSRV1] 0000,0002     18 UI AffectedSOPClassUID    "1.2.840.10008.1.1" 
[CONQUESTSRV1] 0000,0100      2 US CommandField           48 
[CONQUESTSRV1] 0000,0110      2 US MessageID              7 
[CONQUESTSRV1] 0000,0800      2 US DataSetType            257 
[CONQUESTSRV1] 0002,0010     17 UI TransferSyntaxUID      "1.2.840.10008.1.2" 
[CONQUESTSRV1] 9999,0400    150 LO ConquestConsoleComma   "addimagefile:C:\\Users\\fr031735\\Desktop\\20140110130guth\\original\\1.2.840.113619.2.66.2216950631.7936141104090301.10003_167256_000001_14150887570921.dcm" 
[CONQUESTSRV1] ***[AddImageFile] C:\Users\fr031735\Desktop\20140110130guth\original\1.2.840.113619.2.66.2216950631.7936141104090301.10003_167256_000001_14150887570921.dcm -FAILED: file does not contain correct UIDs
-----------------------------------------------------

Display More

We must perhaps modify the images before sending to conquest ?
Is it possible with the command line programm that I found yesterday?

Jean-Christophe

marcelvanherk · Nov 22nd 2014

Hi Jean Christophe,

indeed you have to change the transfer syntax in the files first with the program you found and then drag and drop them.

Marcel

Problem written bigendian mammo images

Participate now!

Share