Posted by
Gary Laevsky on
URL: http://confocal-microscopy-list.275.s1.nabble.com/IT-infrastructure-tp7590206p7590209.html
*****
To join, leave or search the confocal microscopy listserv, go to:
http://lists.umn.edu/cgi-bin/wa?A0=confocalmicroscopyPost images on
http://www.imgur.com and include the link in your posting.
*****
Hi Matthieu,
We just purchased 5 PB and migrated to an Isilon.
We do run some applications on the server, but time there is at a premium.
We also have a few fairly beefy PCs to crunch data locally.
Right now, this is our short-medium-long-term solution. Not sure if we
will migrate to something like Glacier for long-term eventually.
We are collecting cryo and light-sheet, so the numbers are getting up
there. We are also updating applicable systems to 10GB fiber for transfer.
Interested to hear other solutions as well.
Big Data is always a favorite topic at our NAMS meetings, and it's also the
name of our light-sheet workshop next summer as well (plug intended!)!
On Fri, Nov 22, 2019 at 7:54 AM George McNamara <
[hidden email]>
wrote:
> *****
> To join, leave or search the confocal microscopy listserv, go to:
>
http://lists.umn.edu/cgi-bin/wa?A0=confocalmicroscopy> Post images on
http://www.imgur.com and include the link in your posting.
> *****
>
> Hi Matthieu,
>
> 20 TB WD My Book Duo USB 3.1 are $700 ... orWD 20TB My Cloud EX2 Ultra
> Network Attached Storage $999 ...
> <
>
https://www.amazon.com/Cloud-Ultra-Network-Attached-Storage/dp/B07179ZYH2/ref=sr_1_3?crid=3ILUXD0SCQ70Z&keywords=wd+20tb+my+book+duo&qid=1574426442&sprefix=wd+20+tb%2Caps%2C129&sr=8-3>you
>
> may want to have one or more in your facility for backup (move month old
> data) AND encourage P.I.'s to have in for their labs (and most PI's
> think about their research, not about I.T. and need for data backups).
>
> In a previous thread I posted about what we have ... some 10 Gbe
> computers, 10 Gbe server (40 Tb HDD RAID array), and a switch 10 Gbe
> Ethernet (CAT7 copper wire, others pointed out SFP+ fiber optic is less
> expensive ... future: connect our image core rooms to the fiber optic
> switch room), some PCs with ASUS Hyper M.2 PCIe card with 4 Silicon
> Power 2 Tb NVMe SSDs, ~$1050 for 8Tb fast local storage (PCIe x16 slot,
> BIOS configure the slot as x4x4x4x4) ... goal is fast local acquisition
> saving --> fast network --> best wishes.
>
> JHU now provides 5 Terabytes Microsoft OneDrive cloud storage per
> employee/student ... and in principle could call I.T. and get more. So
> far, not easily "aggregated" by lab ... I hope this gets changed so a PI
> of a 20 person lab gets 100 Tb to start with, organized by user (say 1
> Tb private to that user, visible to the PI) and mostly organized by
> projects.
>
> enjoy,
>
> George
>
> On 11/22/2019 6:43 AM, VERMEREN Matthieu wrote:
> > *****
> > To join, leave or search the confocal microscopy listserv, go to:
> >
http://lists.umn.edu/cgi-bin/wa?A0=confocalmicroscopy> > Post images on
http://www.imgur.com and include the link in your
> posting.
> > *****
> >
> > Dear all,
> >
> > We are producing massive amount of data that legally needs to be stored
> for up to ten years. This data also needs to be analysed fairly quickly
> -hence storage on local servers. Furthermore, some software companies
> (Huygens, Imaris...) are now offering server-based applications for image
> analysis -all the hard work is done on the server and your computer is just
> a terminal.
> >
> >
> > Currently, we tell users to transfer their data to NAS immediately after
> imaging, so the microscope computers are not clogged. Image files found on
> these computers are fair game after a month. We expect users to then back
> up their files from the NAS to cloud. All our image analysis is done on
> fairly beefy workstations and not server based.
> >
> > As I'd like to future proof our IT, it would be great to know what
> servers/storage space do you have as part of your facilities/institutes?
> What solutions do you have for long term storage vs short to medium terms?
> Do you have server based applications?
> >
> > Matthieu
> > The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
--
Best,
Gary Laevsky, Ph.D.
Director, Confocal Imaging Facility
Nikon Center of Excellence
Co-Founder, North Atlantic Microscopy Society (NAMS)
https://namsmicroscopy.com/Dept. of Molecular Biology
Washington Rd.
Princeton University
Princeton, New Jersey, 08544-1014
(O) 609 258 5432
(C) 508 507 1310
North Atlantic Microscopy Society Spring Meeting at UPENN, April 23, 2020.