diff --git a/about/facilities.md b/about/facilities.md index cc00bbed..16d188de 100644 --- a/about/facilities.md +++ b/about/facilities.md @@ -8,20 +8,21 @@ If you are writing a grant proposal for research that will use CCV facilities, p ## Computing Resources ### Oscar + CCV provides high-performance computing (HPC) resources and scientific computing expertise to Brown University’s research community. Oscar, CCV’s primary research computing cluster, has - 2 login nodes -- 461 diskless multi-core nodes - - 17,424 CPU cores - - available memory ranging from 95 GB to 2096 GB per node - - sharing a high-performance interconnect and file system and running Red Hat Enterprise Linux 7.3 -- 69 GPU nodes - - total of 474 GPUs - - available memory ranging from 11 to 48 GB VRAM per GPU +- 430 diskless multi-core nodes + - 23,440 CPU cores + - available memory ranging from 95 GB to 2096 GB per node + - sharing a high-performance interconnect and file system and running Red Hat Enterprise Linux 9.2 +- 97 GPU nodes + - more than 750 GPUs + - available memory ranging from 15 to 80 GB VRAM per GPU - xCAT (IBM’s cluster administration toolkit) for provisioning all nodes -- An all-flash parallel filesystem (Vast Data) that provides roughly 4 Petabytes of disk storage and is replicated to Brown University Disaster Recovery (DR) site +- An all-flash parallel filesystem (VAST Data) that provides roughly 4 Petabytes of disk storage and is replicated to Brown University Disaster Recovery (DR) site - A storage system which is integrated with the Hibernate backup/archival system -- 100 Gb/s EDR Infiniband connectivity +- 400 Gb/s NDR & 200Gb/s HDR Infiniband connectivity For more technical details, please see [Oscar's system overview](https://docs.ccv.brown.edu/oscar/system-overview). @@ -31,8 +32,8 @@ CCV also supports the Carney condo for The Robert J. & Nancy D. Carney Institute - 100 Nvidia Quadrortx GPUs, each with 24GB memory - 1.4 PB data storage - ### Stronghold + Stronghold is a secure computing and storage environment that enables Brown researchers to analyze sensitive data, while complying with regulatory or contractual requirements. Stronghold is based on FISMA (Federal Information Security Management Act) requirements using 800-53 controls and meets CJIS (Criminal Justice Information Security) requirements. This service is customized to the needs of individual users and their data use agreements. Each Principal Investigator (PI) is given a dedicated environment for their project to support their researchers, students, and collaborators. Access to the internet is restricted except for required locations for data imports or necessary software downloads and via VPN for workstation access. Import and export controls are in place to limit who can perform data migration, where sensitive data can come from and where desensitized or anonymized data can be moved to. Sensitive data are subject to file system auditing, and real-time alerting is available at the request of the PI. The Stronghold server system resides in the central datacenter located in a dedicated, private facility equipped with fire suppression systems. It is protected by a card access system maintained by the Brown Department of Public Safety. Within the datacenter the hardware is contained in a locked cabinet with a limited access list for maintenance. The Stronghold environment includes security protections for secure user authentication protocols including two-factor authentication, as well as multiple layers of firewall protection, multiple methods to prevent and detect unauthorized access, regular operating system security patch updates and remote access via virtual private network (VPN) protocol. Stronghold supports multiple protocols (SFTP, FTPS, HTTPS) for transferring data into the environment. @@ -40,19 +41,23 @@ The Stronghold server system resides in the central datacenter located in a dedi To date, Stronghold has over 60 tenants with over 50 Principal Investigators and over 500 users. Stronghold has undergone internal audits, external audits by a leading security firm and is consistently under review for improvements by Brown’s technical team. ### dbGaP + Use of dbGaP data on the computing cluster is restricted to a Singularity software container mechanism that isolates the application from outside networking. It also restricts storage write access to a special area on the enterprise Isilon platform that is reserved for dbGaP use. A separate transfer gateway system with file access auditing provides a path for dbGaP data transfer into the system, as well as the transfer of computational results out of the system. ## CCV Staff + CCV’s state-of-the-art infrastructure is maintained and operated by CCV staff, who have extensive experience in operating shared computational clusters. CCV staff members are responsible for scheduled maintenance, access control, and integration with research-specific hardware as required by researchers. A large collection of software is available on Oscar, including: R, Matlab, Mathematica, Maple, and a large range of optimized math and science libraries and domain-specific applications. CCV staff members are available to assist with the acquisition and installation of any applications not already available on Oscar. CCV staff members are also available to consult on research projects and work directly to support and develop the advanced computational methods used by researchers at Brown. Please contact [CCV](mailto:support@ccv.brown.edu) if you need a more detailed description. ### How to Cite CCV -If you publish research that benefited from the use of CCV services or resources, we would greatly appreciate an acknowledgment that states: +If you publish research that benefited from the use of CCV services or resources, we would greatly appreciate an acknowledgment that states: For resources: + > This research [Part of this research] was conducted using [computational/visualization] resources and services at the Center for Computation and Visualization, Brown University. For help from our Research Staff: + > This work [Part of this work] was conducted with the help of research staff at the Center for Computation and Visualization, Brown University. diff --git a/about/people.yml b/about/people.yml index 528c47c5..c48d805d 100644 --- a/about/people.yml +++ b/about/people.yml @@ -148,7 +148,7 @@ data: type: Full Time team: CCV Operations subteam: Research Technical Services - title: Research Service Center Manager + title: Assistant Director Research Computing Services github_username: yangliu2009 brown_directory_uuid: e0e55df3-9f2c-4a12-a1de-742955164e1e bio: @@ -157,7 +157,7 @@ data: type: Full Time team: CCV Operations subteam: Research Technical Services - title: Research Computing Specialist + title: Senior Research Computing Consultant github_username: prasadbandarkar brown_directory_uuid: 11533980-c5cd-4969-81ca-537543da9b72 bio: @@ -282,7 +282,7 @@ data: in the intersection of XR technologies with science, data, art, and visualization. Robert received his undergraduate degree in Computer Science from the University of Rhode Island where he also minored in music. - image: gemma_main.jpg + image: robert_main.jpg - name: Paul Hall type: Full Time team: Advanced Research Computing @@ -298,7 +298,7 @@ data: type: Full Time team: Advanced Research Computing subteam: Graphics, Software, and Data Core - title: Data Scientist + title: Senior Data Scientist github_username: tdivoll brown_directory_uuid: d98138f4-a49c-4e1b-9bc4-1832b51f6f46 bio: @@ -384,15 +384,6 @@ data: brown_directory_uuid: 0b37438d-b5c2-41d6-9d87-14c446698a07 bio: Anna is a software engineer and researcher with the CCV with a background in full-stack web development. She loves thinking about technology and media, and the different impacts they both have on the world. image: anna_main.jpg - - name: Galen Winsor - type: Full Time - team: Advanced Research Computing - subteam: Graphics, Software, and Data Core - title: Research Software Engineer - github_username: galenwinsor - brown_directory_uuid: 77e8343c-498a-4bed-bedf-ed0a59d0fa3c - bio: Galen earned his Bachelor's degree from Brown in 2022 in Computer Science and Environmental Studies. His professional interests include web software architecture, UI/UX, and data visualization. Outside of work, he loves playing music, playing tennis and squash, and hiking. - image: galen_main.jpg - name: Rain Fan type: Full Time team: CCV Operations @@ -431,4 +422,4 @@ data: github_username: gpsss246 brown_directory_uuid: bed03629-ed04-429d-af97-64fa7415d182 bio: Gurpartap Singh studies Computer Science and Political Science at Brown University as a member of the Class of 2026. You can find Gurpartap listening to music or learning how to create it (ask me about the Alan Turing Album). I make a good cup of Masala Cha so feel free to ask for a cup! - image: gurpartap_main.png + image: gurpartap_main.png \ No newline at end of file diff --git a/images/people/galen_hover.jpg b/images/people/galen_hover.jpg deleted file mode 100644 index d5ba3759..00000000 Binary files a/images/people/galen_hover.jpg and /dev/null differ diff --git a/images/people/galen_main.jpg b/images/people/galen_main.jpg deleted file mode 100644 index db346c7a..00000000 Binary files a/images/people/galen_main.jpg and /dev/null differ diff --git a/images/people/gemma_hover.jpg b/images/people/gemma_hover.jpg deleted file mode 100644 index 918e546d..00000000 Binary files a/images/people/gemma_hover.jpg and /dev/null differ diff --git a/images/people/gemma_main.jpg b/images/people/gemma_main.jpg deleted file mode 100644 index c87bcc36..00000000 Binary files a/images/people/gemma_main.jpg and /dev/null differ diff --git a/images/people/robert_hover.jpg b/images/people/robert_hover.jpg new file mode 100644 index 00000000..108e9e93 Binary files /dev/null and b/images/people/robert_hover.jpg differ diff --git a/images/people/robert_main.jpg b/images/people/robert_main.jpg new file mode 100644 index 00000000..13a62957 Binary files /dev/null and b/images/people/robert_main.jpg differ diff --git a/services/computing/virtual-machines.md b/services/computing/virtual-machines.md index 5c4543b6..e7aa59c8 100644 --- a/services/computing/virtual-machines.md +++ b/services/computing/virtual-machines.md @@ -2,15 +2,15 @@ title: Virtual Machine Hosting icon: desktop-mac --- + Virtual Hosting is aimed at departments or researchers who want access to a Server but don’t want to purchase or maintain the hardware. The virtual machines (VMs) can be either Windows or Linux servers. Depending on your needs, we can assist with basic system administration and maintenance. ## To Request this Service -Please complete this [form](https://brown.co1.qualtrics.com/jfe/form/SV_6Jv0o5Ded65UWot). +Please complete this [form](https://brown.atlassian.net/servicedesk/customer/portal/12/create/200). We do not currently support GPUs in this environment. - ## VM Environment sizing limits: Hosting DMZ - is an internet facing environment with a CPU sizing limit of 16 cores and a Memory sizing limit of 128GB RAM for your virtual machine diff --git a/services/file-storage-and-transfer/brown-storage.md b/services/file-storage-and-transfer/brown-storage.md index 59f48b98..85610926 100644 --- a/services/file-storage-and-transfer/brown-storage.md +++ b/services/file-storage-and-transfer/brown-storage.md @@ -3,6 +3,233 @@ title: Brown Storage Options icon: database --- -Several services at Brown allow you to share and store files. These different storage services each have their own relative benefits and features. You can explore the differences with our comparison tool using the link below. +Several services at Brown allow you to share and store files. These different +storage services each have their own relative benefits and features. You can +explore the differences with our comparison tool using the link below. -Compare Storage Options +
+ Campus File Storage Non-replicated / Research Services +

+ File Services for Research provides Brown University research departments + with a location in which files can be stored, backed up, and shared with members + of the Brown community using Brown ID’s and groups. Space is allocated to each + research lab or PI with an ITHelp request, and security groups are required to define + access to the data. The data is protected locally via snapshots but doesn’t have + geo-redundancy (secondary copy). +

+ +
+ +
+ Campus File Storage Replicated / Research Services +

+ File Services for Research provides Brown University research departments + with a location in which files can be stored, backed up, and shared with + members of the Brown community using Brown ID’s and groups. Space is allocated + to each research lab or PI with an ITHelp request, and security groups are + required to define access to the data. The data is replicated daily to our + disaster recovery site for True geo-redundant data protection. The data is + accessible on Brown's campus networks (including VPN and wireless). +

+ +
+ +
+ Campus File Storage / Department File Services +

+ Departmental File Services provides University departments with a location in which + files can be stored, backed up, and shared across the department. The service can be + accessed by mapping the drive on your computer ( + Windows Explorer + on PC or Finder + on a Mac), or by visiting webfiles.brown.edu + in a web browser. (For researchers, please check out "Campus File Storage + replicated/non-replicated / Research services " section) +

+ + +
+ +
+ Oscar Storage +

+ Oscar storage, also known as Computational Data Storage, is a high-performance + data storage system which is accessible from any computer connected to Brown's + campus network, or from outside the network via ssh. What sets this option apart + from the others is that it is directly connected to Brown’s primary supercomputer, + “Oscar”, making computation easier. If you don’t intend to compute your data with + Brown’s supercomputer, you may consider using Campus File Storage instead. You could + also use Oscar storage for computing and then move your results to Campus File Storage + for greater accessibility, reliability, and protection. +

+ +
+ +
+ Stronghold +

+ Stronghold + is a secure computing and storage environment that enables Brown researchers to analyze sensitive data + while complying with regulatory or contractual requirements. +

+ +
+ +
+ Hibernate +

+ Hibernate is a secure, reliable, + research data archive solution. Hibernate is a Brown OIT archival service for the + research community to migrate inactive data off active Network-attached storage (NAS) + platforms onto a lower cost, long-term retention environment. +

+ +
+ +
+ Lab Archives +

+ LabArchives is a cloud-based electronic lab notebook that can be used by researchers, + instructors, and students for input and organization of laboratory data, information + sharing, and collaboration, and for saving historical versions of files. It is appropriate + for use in a wide variety of laboratories, including biological sciences, chemistry and + physical sciences, and engineering, among others. +

+

+ LabArchives at Brown provides unlimited storage space. The current size limit per file is 4GB. +

+

+ LabArchives at Brown is not approved for storing files containing Personally Identifiable + Information (PII), Protected Health Information (PHI), or Brown Restricted Information. +

+ +
+ +
+ Brown Digital Repository +

+ The Brown Digital Repository (BDR) is a place to gather, index, store, preserve, and make + available digital assets produced via the scholarly, instructional, research, and administrative + activities at Brown. +

+

The Brown University Library maintains the repository as a service to the Brown community; it provides:

+ +

+ Faculty and researchers interested in using the Brown Digital Repository as a platform for + programmatic data management, storage, and publication should contact the Library (bdr@brown.edu) + for information about opportunities for research consulting and project development support. +

+ +
+ +
+ Google Drive +

+ Google Drive gives you space to store and share documents. The native Google document + formats allow for real-time collaboration and file history. You can also store unconverted files + of various types in your Google Drive. It's easy to share files with members of the Brown community + (including Google Groups) and non-Brown Google accounts; files can be shared with view-only, comment, + or edit access. Google also has a really nice feature where you can scan in handwritten documents and + have them converted to text. You can access files on the web, through a mobile app, or by installing + Google Drive on your computer (which makes it act like a folder on your computer). +

+ +
+
+

+ Compare Storage Options + Request Storage + Request Quota Change + Storage Help +

diff --git a/storage-tool.yml b/storage-tool.yml index 4ae7ff10..0ccd8d0d 100644 --- a/storage-tool.yml +++ b/storage-tool.yml @@ -17,7 +17,7 @@ storage_tool_header: | services: - name: "Google Drive" description: | - Google Drive gives you unlimited space to store and share documents. + Google Drive gives you space to store and share documents. The native Google document formats allow for real-time collaboration and file history. You can also store unconverted files of various types in your Google Drive. It's easy to share files with members of the Brown community (including Google Groups) @@ -28,7 +28,7 @@ services: computer). - Best for: Collaboration in native Google files, easy access from anywhere, small amount of total storage, sharing with Google Groups. - Limitations: Data transfer speeds may be very limited, Globus can provide high bandwidth data transfers. - - More info: [Service Catalog](https://it.brown.edu/services/type/google-drive) | [Documentation](https://ithelp.brown.edu/kb/48-google-drive) | [Redundancy](https://storage.googleapis.com/gfw-touched-accounts-pdfs/google-cloud-security-and-compliance-whitepaper.pdf) + - More info: [Documentation](https://ithelp.brown.edu/kb/48-google-drive) | [Security](https://storage.googleapis.com/gfw-touched-accounts-pdfs/google-cloud-security-and-compliance-whitepaper.pdf) features: - name: relative_speed @@ -69,17 +69,15 @@ services: - name: campus_file_storage_non-replicated description: | - File Services for Research provides Brown University research departments with a - location in which files can be stored, backed up, and shared with members of the - Brown community using Brown ID’s and groups. Space is allocated to each research - lab or PI with an ITHelp request , security groups are required to define access - to the data. The data is accessible on Brown's campus networks (including VPN and - wireless). - - Synonyms: LRS.Brown.EDU, LRSFiles, Qumulo + File Services for Research provides Brown University research departments with a location in which + files can be stored, backed up, and shared with members of the Brown community using Brown ID’s and groups. + Space is allocated to each research lab or PI with an ITHelp request , security groups are required to + define access to the data. The data is protected locally via snapshots but doesn’t have + geo-redundancy (secondary copy). - Best for: Brown faculty and staff researchers looking to store, share and protect research data. - - Limitations: Not intended for high throughput research computing, you can access this storage on the transfer nodes and utilize HPC scratch for accelerated computing. + - Accessibility: The data is accessible on Brown's campus networks (including VPN and wireless). Also accessible directly from High Performance Computing Cluster (Oscar). + - Limitations: No geo-redundancy (secondary copy) - Rate: $50/TB/Year when storing above free/grant allocations - - More info: [Documentation](https://docs.google.com/document/d/1IUBLNqXDnCZk1d4A3RlG823IxKTKiWlVc618vTjI170/edit?usp=sharing) | [Replication](https://ithelp.brown.edu/kb/articles/decide-how-to-store-and-share-files-for-researchers#replication) | [Request this service ](https://brown.co1.qualtrics.com/jfe/form/SV_a5DbCjYNMb5iU0B) features: - name: relative_speed class: faster @@ -104,9 +102,9 @@ services: notes: - except with Globus - name: access_from_oscar - class: partial + class: True notes: - - accessible on transfer nodes + - Multi-Protocol Share - name: security class: 2 notes: @@ -133,11 +131,10 @@ services: the data. The data is replicated daily to our disaster recovery site for True geo-redundant data protection. The data is accessible on Brown's campus networks (including VPN and wireless). - - Synonyms: Files.Brown.EDU, Files, Isilon - Best for: Brown faculty and staff researchers looking to store, share and protect research data. - - Limitations: Not intended for high throughput research computing, you can access this storage on the transfer nodes and utilize HPC scratch for accelerated computing. + - Accessibility: The data is accessible on Brown's campus networks (including VPN and wireless). Also accessible directly from High Performance Computing Cluster (Oscar). + - Sharing: The data can be shared with both Brown and non-Brown collaborators via Globus. - Rate: $100/TB/Year when storing above free/grant allocations - - More info: [Documentation](https://docs.google.com/document/d/1GiUyKqo6sk9c00tOAkR3Q_GBlBhGs2Ob8EO6pYneNDc/edit?usp=sharing) | [Replication](https://ithelp.brown.edu/kb/articles/decide-how-to-store-and-share-files-for-researchers#replication) | [Request this service](https://brown.co1.qualtrics.com/jfe/form/SV_a5DbCjYNMb5iU0B) features: - name: relative_speed class: faster @@ -162,9 +159,9 @@ services: notes: - except with Globus - name: access_from_oscar - class: partial + class: True notes: - - accessible on transfer nodes + - Multi-Protocol Share - name: security class: 2 notes: @@ -176,7 +173,7 @@ services: - 10 TB per grant - Paid after that @ $100/TB/Yr. (Summed across all paid storage types) - name: max_file_size - class: 4 TB + class: 128 TB notes: - 1 TB for best performance - name: storage_warmth @@ -270,12 +267,8 @@ services: class: True - name: brown_network_required class: True - notes: - - except with Globus - name: access_from_oscar class: False - notes: - - accessible on transfer nodes - name: security class: 2 notes: @@ -291,9 +284,14 @@ services: - name: oscar_storage description: | - Oscar storage is a high-performance data storage system which is accessible from any computer connected from Brown's campus network, or from outside the network via ssh. It is backed up nightly on an incremental basis. What sets this option apart from the others is that it is directly connected to Brown’s primary supercomputer, “Oscar”, making computation easier. If you don’t intend to compute your data with Brown’s supercomputer, you may consider using Campus File Storage instead. You could also use Oscar storage for computing and then move your results to Campus File Storage for greater accessibility, reliability, and protection. + Oscar storage, also known as Computational Data Storage, is a high-performance data storage system which is + accessible from any computer connected from Brown's campus network, or from outside the network via ssh. + What sets this option apart from the others is that it is directly connected to Brown’s primary supercomputer, + “Oscar”, making computation easier. If you don’t intend to compute your data with Brown’s supercomputer, you + may consider using Campus File Storage instead. You could also use Oscar storage for computing and then move + your results to Campus File Storage for greater accessibility, reliability, and protection. - - Synonyms: RData, HPC Storage, GPFS (historically) + - Synonyms: Oscar Data, HPC Storage, GPFS (historically) - Best for: High performance storage of research data, perform computation on your data using Brown’s supercomputer - Limitations: Not accessible on all campus networks. - Rate: $100/TB/Year when storing above free/grant allocations @@ -335,17 +333,19 @@ services: - Paid after that @ $100/TB/Yr. (Summed across all paid storage types) - name: max_file_size class: 128 TB + notes: + - 1 TB for best performance - name: storage_warmth class: hot - name: stronghold description: | - Stronghold is a secure computing and storage environment that enables + [Stronghold](https://it.brown.edu/services/stronghold-research-environment-data-compliance) is a secure computing and storage environment that enables Brown researchers to analyze sensitive data while complying with regulatory or contractual requirements. - Best for: Storing data with data usage agreements, FISMA, etc. - Rate: $100/TB/Year when storing above free/grant allocations - - More info: [Service Catalog](https://it.brown.edu/services/type/stronghold-research-environment-data-compliance) | [Request this service](https://www.brown.edu/cis/forms/Stronghold/shold.php) + - More info: [Request this service](https://www.brown.edu/cis/forms/Stronghold/shold.php) features: - name: relative_speed class: faster @@ -390,7 +390,7 @@ services: description: | [Hibernate](https://docs.ccv.brown.edu/hibernate/) is a secure, reliable, research data archive solution. Hibernate is a Brown OIT archival service for the research community to migrate inactive data off active Network-attached storage (NAS) platforms onto a lower cost, long-term retention environment. - * Hibernate leverages [StarFish](https://docs.ccv.brown.edu/starfish/) an application that provides a metadata and rules-based management framework for large file systems. StarFish makes storage tiering easy: moving data, reporting, zones. + * Hibernate leverages [StarFish](https://docs.ccv.brown.edu/starfish/), an application that provides a metadata and rules-based management framework for large file systems. StarFish makes storage tiering easy: moving data, reporting, zones. * A zone is a virtual-volume or collection of branches across different file-systems (Oscar storage, Isilion, LRS etc.). Each PI group is distributed into an individual zone. A zone provides: * Types/sizes of files, access times * Hot Spots (Growth, user(s)/Group(s)