![]() ![]() ![]() If you would like to keep data on the local scratch disk of your nodes, create a directory with group name and put your data there (if your UNIX group is hyak-mygroup, you would create /scr/mygroup). The local scratch disk is cleaned up after each job completes. ![]() mpiBLAST, for example, partitions a reference database and distributes it among the nodes participating in a calculation to achieve better I/O scaling. This is available to you for use in cases where your application performance is limited by the shared scratch. These filesystems are accessible only to the local node and are not shared with any other Hyak nodes. MOX: mmlsquota -block-size G gscratch:homeĮach node in Hyak has an /scr filesystem, typically with ~100GB of space. Check your quotas with the mmlsquota command: Quotas in the shared scratch space are managed based on file group association. Running find with any of the time options such as mtime or atime may not produce expected results.Įach hyak group is assigned a filesystem quota based on the number of nodes it owns. Both these configurations are to improve the performance on /gscratch. Nonetheless, it's worthwhile to check to be sure the group association of files you create is correct.įile modification time (mtime) is only periodically updated and file access time (atime) is disabled on the /gscratch filesystem. This ensures any files you create within inherit the group association of the parent directory. Shared scratch directories are configured "setgid". Some of you have additional shared scratch space dedicated to your projects. Some situations might benefit from the use of node-local scratch space described below. Please use your group's /gscratch directory in most situations requiring large data volume, high throughput, or high transaction rates, or in any situation where you will need to share data with other users. You can determine your group by looking at the output from the groups command. If your group is hyak-mygroup, your directory would be /gscratch/mygroup. Each Hyak group has an eponymous shared scratch directory under /gscratch which is shared among all Hyak nodes. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |