<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Hi Nicolas,
<div class=""><br class="">
</div>
<div class="">I checked the INSERT statements but no one has a SessionID set to 845.</div>
<div class=""><br class="">
</div>
<div class="">
<blockquote type="cite" class="">
<div dir="ltr" class="">
<div class="">Also, are you sure you did not manually delete records from mri_upload after the delete script was run?</div>
</div>
</blockquote>
<div class=""><br class="">
</div>
Yes, I’ve only used the script. However, I recall that during the insertion of this study I had issues with the insertion of the images, for instance I had errors in the middle of the pipeline.</div>
<div class=""><br class="">
</div>
<div class="">Let me know if a call can be helpful to figure this out faster.</div>
<div class=""><br class="">
</div>
<div class="">Best,</div>
<div class="">Alfredo.<br class="">
<div><br class="">
<blockquote type="cite" class="">
<div class="">On Apr 15, 2020, at 3:42 PM, Nicolas Brossard <<a href="mailto:nicolasbrossard.mni@gmail.com" class="">nicolasbrossard.mni@gmail.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<p class=""><span style="padding: 3px 10px; border-radius: 5px; color: #ffffff; font-weight: bold; display: inline-block; background-color: #ff0000;" class=""> External Email - Use Caution </span></p>
<div class=""><br class="webkit-block-placeholder">
</div>
<div dir="ltr" class="">Hi Alfredo,
<div class=""><br class="">
</div>
<div class="">Yep, all clear. Tables mri_upload and tarchive both have a column SessionID. You said you did not find in your backup files an UPDATE statement for session 845. Can you check in your backup files the INSERT statements for tables mri_upload and
tarchive? Do any of these statements have a SessionID set to 845?</div>
<div class=""><br class="">
</div>
<div class="">Also, are you sure you did not manually delete records from mri_upload after the delete script was run?</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">Best,</div>
<div class="">Nicolas</div>
</div>
<br class="">
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Apr 15, 2020 at 3:32 PM Morales Pinzon, Alfredo <<a href="mailto:AMORALESPINZON@bwh.harvard.edu" class="">AMORALESPINZON@bwh.harvard.edu</a>> wrote:<br class="">
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="overflow-wrap: break-word;" class="">Hi Nicolas,
<div class=""><br class="">
</div>
<div class="">Apologies for not being clear in my last email. I meant to say that after removing 3200 upload ids and didn’t find the session 845 in any of the backup SQL generated files. I have multiple back up files as I removed the 3200 ids one by one. Is
it clear now?</div>
<div class=""><br class="">
</div>
<div class="">Best,</div>
<div class="">Alfredo.</div>
<div class="">
<div class=""><br class="">
<blockquote type="cite" class="">
<div class="">On Apr 15, 2020, at 2:17 PM, Nicolas Brossard <<a href="mailto:nicolasbrossard.mni@gmail.com" target="_blank" class="">nicolasbrossard.mni@gmail.com</a>> wrote:</div>
<br class="">
<div class="">
<p class=""><span style="padding:3px 10px;border-radius:5px;color:rgb(255,255,255);font-weight:bold;display:inline-block;background-color:rgb(255,0,0)" class=""> External Email - Use Caution </span></p>
<div class=""><br class="">
</div>
<div dir="ltr" class="">Hi Alfredo,
<div class=""><br class="">
</div>
<div class="">So what you are saying is that the script deleted a record in table mri_upload with uploadid = 3200 but there was no corresponding UPDATE session statement? In your previous email you were referring to a session with ID 845 that had scan_done
set to 'Y' even though there were no archives associated to it. Was the mri_upload with uploadid 3200 tied to session 845? Are you able to see in the backup file all the mri_uploads tied to session 845 that were deleted? </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">Nicolas</div>
</div>
<br class="">
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Apr 15, 2020 at 12:51 PM Morales Pinzon, Alfredo <<a href="mailto:AMORALESPINZON@bwh.harvard.edu" target="_blank" class="">AMORALESPINZON@bwh.harvard.edu</a>> wrote:<br class="">
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div class="">Hi Nicolas,
<div class=""><br class="">
</div>
<div class="">I checked the records, for the 3200 deleted uploadId, and the sessionID was not in there. Also, the UPDATE statement was issues in the same table. Here is an example of INSERT and UPDATE commands in the SQL file:</div>
<div class=""><br class="">
</div>
<div class="">===</div>
<div class="">
<div style="margin:0px;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo" class="">
<span style="font-variant-ligatures:no-common-ligatures" class=""><font class="">INSERT INTO `mri_upload` VALUES (9,'lorisadmin\n','2017-11-28 16:30:47',’/ABC/AAB21935_880779_m00.tar.gz','/tmp/ImagingUpload-16-30-jIjf1G',1,0,'AAB21935_880779_m00',8,8,6,</font><font color="#ff1f00" class="">4</font><font class="">,1,1,'N');</font></span></div>
<div style="margin:0px;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo" class="">
<span style="font-variant-ligatures:no-common-ligatures" class="">UPDATE session s SET Scan_done = 'Y' WHERE s.ID IN (4) AND (SELECT COUNT(*) FROM mri_upload m WHERE m.SessionID=s.ID) > 0; </span></div>
</div>
<div class="">===</div>
<div class=""><br class="">
</div>
<div class="">Maybe the insertion process didn’t finish properly but the state of the database was updated? As you can see this images were uploaded in 2017 using LORIS v17.0.0 or v18.0.0. Let me know if you have more suggestions on what to check and how we
can solve this.</div>
<div class=""><br class="">
</div>
<div class="">Best,</div>
<div class="">Alfredo.</div>
<div class="">
<div class=""><br class="">
<blockquote type="cite" class="">
<div class="">On Apr 13, 2020, at 8:37 PM, Nicolas Brossard <<a href="mailto:nicolasbrossard.mni@gmail.com" target="_blank" class="">nicolasbrossard.mni@gmail.com</a>> wrote:</div>
<br class="">
<div class="">
<p class=""><span style="padding:3px 10px;border-radius:5px;color:rgb(255,255,255);font-weight:bold;display:inline-block;background-color:rgb(255,0,0)" class=""> External Email - Use Caution </span></p>
<div class=""><br class="">
</div>
<div dir="ltr" class="">Hi Alfredo,
<div class=""><br class="">
</div>
<div class="">I am curious to see the actual records that the delete script removed from your mri_upload table. Since the delete script backs up what it deletes, you can have a look inside the backup file it created. By default, this file is named imaging_upload_backup.tar.gz.
Inside, you'll find an SQL file that should contain all the entries in mri_upload that were deleted. Can you check if all of them have a sessionID set to 845 (they should)? Can you also check in the same file the UPDATE statement that was issued on the session
table? We'll start with these checks first.</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">Best,</div>
<div class="">Nicolas</div>
<div class=""><br class="">
</div>
</div>
<br class="">
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Mon, Apr 13, 2020 at 8:16 PM Morales Pinzon, Alfredo <<a href="mailto:AMORALESPINZON@bwh.harvard.edu" target="_blank" class="">AMORALESPINZON@bwh.harvard.edu</a>> wrote:<br class="">
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div class="">Dear LorisDev Team,
<div class=""><br class="">
</div>
<div class="">I recently removed all the UploadIDs from a study using the script “<font face="Helvetica Neue" class=""><span class=""><a href="http://delete_imaging_upload.pl/" target="_blank" class="">delete_imaging_upload.pl</a></span><span class="">”</span><span class="">.
However, in the front-end I can see some </span><span class="">imaging visits for some candidates of the study. </span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class=""><br class="">
</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class="">Here is an example for one visit:</span></font></div>
<div class=""><br class="">
</div>
<div class="">Here is the imaging session for one the Candidates with the issue:</div>
<div class=""><font face="Helvetica Neue" class=""><span class="">===</span></font></div>
<div class="">
<div class=""><font face="Menlo" class="">select * from session where CandID in (450030) \G;</font></div>
<div class=""><font face="Menlo" class="">*************************** 1. row ***************************</font></div>
<div class=""><font face="Menlo" class=""> <font color="#ff1f00" class="">
ID: 845</font></font></div>
<div class=""><font face="Menlo" class=""> CandID: 450030</font></div>
<div class=""><font face="Menlo" class=""> CenterID: 60</font></div>
<div class=""><font face="Menlo" class=""> VisitNo: 1</font></div>
<div class=""><font face="Menlo" class=""> Visit_label: m00</font></div>
<div class=""><font face="Menlo" class=""> SubprojectID: 2</font></div>
<div class=""><font face="Menlo" class=""> Submitted: N</font></div>
<div class=""><font face="Menlo" class=""> Current_stage: Not Started</font></div>
<div class=""><font face="Menlo" class=""> Date_stage_change: NULL</font></div>
<div class=""><font face="Menlo" class=""> Screening: NULL</font></div>
<div class=""><font face="Menlo" class=""> Date_screening: NULL</font></div>
<div class=""><font face="Menlo" class=""> Visit: NULL</font></div>
<div class=""><font face="Menlo" class=""> Date_visit: NULL</font></div>
<div class=""><font face="Menlo" class=""> Approval: NULL</font></div>
<div class=""><font face="Menlo" class=""> Date_approval: NULL</font></div>
<div class=""><font face="Menlo" class=""> Active: Y</font></div>
<div class=""><font face="Menlo" class=""> Date_active: 2017-11-10</font></div>
<div class=""><font face="Menlo" class=""> RegisteredBy: 5216-ICR_dataman</font></div>
<div class=""><font face="Menlo" class=""> UserID: 5216-ICR_dataman</font></div>
<div class=""><font face="Menlo" class=""> Date_registered: 2017-11-10</font></div>
<div class=""><font face="Menlo" class=""> Testdate: 2017-11-30 11:07:25</font></div>
<div class=""><font face="Menlo" class=""> Hardcopy_request: -</font></div>
<div class=""><font face="Menlo" class=""> BVLQCStatus: NULL</font></div>
<div class=""><font face="Menlo" class=""> BVLQCType: NULL</font></div>
<div class=""><font face="Menlo" class=""> BVLQCExclusion: NULL</font></div>
<div class=""><font face="Menlo" class=""> QCd: NULL</font></div>
<div class=""><font face="Menlo" class=""> <font color="#ff1f00" class="">
Scan_done: Y</font></font></div>
<div class=""><font face="Menlo" class=""> MRIQCStatus:</font></div>
<div class=""><font face="Menlo" class=""> MRIQCPending: N</font></div>
<div class=""><font face="Menlo" class="">MRIQCFirstChangeTime: NULL</font></div>
<div class=""><font face="Menlo" class=""> MRIQCLastChangeTime: NULL</font></div>
<div class=""><font face="Menlo" class=""> MRICaveat: false</font></div>
</div>
<div class=""><font face="Helvetica Neue" class=""><span class="">===</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class=""><br class="">
</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class="">However, there is no TarchiveID associated with the session id in the mri_upload table</span></font></div>
<div class=""><span class=""><font face="Menlo" class="">===</font></span></div>
<div class=""><span class=""><font face="Menlo" class="">
<div class=""><span class="">select TarchiveID from mri_upload where SessionID=</span><font color="#ff1f00" class="">845</font><span class=""> \G;</span></div>
<div class="">Empty set (0.00 sec)</div>
</font></span></div>
<div class=""><span class=""><font face="Menlo" class="">===</font></span></div>
<div class=""><font face="Helvetica Neue" class=""><span class=""><br class="">
</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class="">Any ideas on how can I fix this.</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class=""><br class="">
</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class="">Thank you in advance for your help.</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class=""><br class="">
</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class="">Regards,</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class="">Alfredo.</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class=""><br class="">
</span></font></div>
<div class=""><font face="Helvetica Neue" class=""><span class=""><br class="">
</span></font></div>
</div>
_______________________________________________<br class="">
Loris-dev mailing list<br class="">
<a href="mailto:Loris-dev@bic.mni.mcgill.ca" target="_blank" class="">Loris-dev@bic.mni.mcgill.ca</a><br class="">
<a href="https://mailman.bic.mni.mcgill.ca/mailman/listinfo/loris-dev" rel="noreferrer" target="_blank" class="">https://mailman.bic.mni.mcgill.ca/mailman/listinfo/loris-dev</a><br class="">
</blockquote>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
<div class=""><br class="webkit-block-placeholder">
</div>
<p class="">The information in this e-mail is intended only for the person to whom it is<br class="">
addressed. If you believe this e-mail was sent to you in error and the e-mail<br class="">
contains patient information, please contact the Partners Compliance HelpLine at<br class="">
<a href="http://www.partners.org/complianceline" target="_blank" class="">http://www.partners.org/complianceline</a> . If the e-mail was sent to you in error<br class="">
but does not contain patient information, please contact the sender and properly<br class="">
dispose of the e-mail.</p>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>