Posted by
mcammer on
URL: http://confocal-microscopy-list.275.s1.nabble.com/Data-Storage-tp7585019p7585021.html
*****
To join, leave or search the confocal microscopy listserv, go to:
http://lists.umn.edu/cgi-bin/wa?A0=confocalmicroscopyPost images on
http://www.imgur.com and include the link in your posting.
*****
We are very fortunate to have institutional support of oodles of space. This is necessary because new imaging instruments can generate up to 2 TB of data in an overnight run.
However, speed is a problem. The network infrastructure was built years ago so it takes 6-8 hrs to transfer a TB to or from the server. Recently this has been shortened to 3-4 hours, but still feels long. IT support is working hard to get the file transfer faster, but want to point out that the network infrastructure needs to match the data sizes.
=========================================================================
Michael Cammer, Microscopy Core & Skirball Institute, NYU Langone Medical Center
Cell: 914-309-3270 ** Office: Skirball 2nd Floor main office, back right **
http://ocs.med.nyu.edu/microscopy &
http://microscopynotes.com/-----Original Message-----
From: Confocal Microscopy List [mailto:
[hidden email]] On Behalf Of Claire Brown, Dr.
Sent: Monday, April 11, 2016 11:27 AM
To:
[hidden email]
Subject: Data Storage
*****
To join, leave or search the confocal microscopy listserv, go to:
https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.umn.edu_cgi-2Dbin_wa-3FA0-3Dconfocalmicroscopy&d=CwIFAg&c=j5oPpO0eBH1iio48DtsedbOBGmuw5jHLjgvtN2r4ehE&r=oU_05LztNstAydlbm5L5GDu_vAdjXk3frDLx_CqKkuo&m=3y6syIJd7MEBDtd_jO_IbwpmCCOmpNTdNPlaUrtAanI&s=k47F_3XHSRP5tl1Y5eVuAD4mbKoAHZjOUBSekJDy_E0&e=
Post images on
https://urldefense.proofpoint.com/v2/url?u=http-3A__www.imgur.com&d=CwIFAg&c=j5oPpO0eBH1iio48DtsedbOBGmuw5jHLjgvtN2r4ehE&r=oU_05LztNstAydlbm5L5GDu_vAdjXk3frDLx_CqKkuo&m=3y6syIJd7MEBDtd_jO_IbwpmCCOmpNTdNPlaUrtAanI&s=PvdK4lIR6akId-H0qR0mgNOPJENX5z3W7LGlmlrUiA0&e= and include the link in your posting.
*****
I'm working on some numbers for cyberinfrastructure for Compute Canada. I am not currently doing single point localization microscopy but we plan to get into it.
I just wonder is there a consensus in the field if the raw images for each point localization have to be retained for 7 years or are people just keeping the localization data? When I do these calculations I get the following so it seems impossible with existing infrastructure to retain the raw data.
2000 x 2000 pixel camera and 16-bit images = 2000x2000x16 = 64 MB per image
10,000 frames for single molecule imaging and two colour super resolution
10,000x2x64 = 1.28 TB
4 conditions, 10 images per condition, experiment done in triplicate
1.28 TBx4x10x3 = 154 TB per experiment
So I'm guessing people are not keeping the raw data or I made a mistake in my calculations.
Looking forward to some feedback!
Sincerely,
Claire
------------------------------------------------------------
This email message, including any attachments, is for the sole use of the intended recipient(s) and may contain information that is proprietary, confidential, and exempt from disclosure under applicable law. Any unauthorized review, use, disclosure, or distribution is prohibited. If you have received this email in error please notify the sender by return email and delete the original message. Please note, the recipient should check this email and any attachments for the presence of viruses. The organization accepts no liability for any damage caused by any virus transmitted by this email.
=================================