ECFS ClearTier Manual Cooling/ Warming Files

Introduction:

  • ClearTier is a unique feature by Elastifile which provides you the ability to define an object tier based on a cloud provider or an on-prem solution from a variety that Elastifile supports
  • The object-based secondary storage tier for data objects not requiring the higher access speed as the primary storage, because they are not accessed often
  • With ClearTier, you set a hot/ cold storage policy by defining the ratio between primary storage and object tier, and when files that were not accessed are moved to the cold tier.
  • The clients can access the data transparently  using the NFS protocol.


Manual Cooling/ Warming Process:

* In this stage you should have an Elastifile Data Container with some data written into it

  1. Login to the EMS and change the source to elfs_admin
    snir_zana@emanage ~$ sudo su - 
    root@emanage ~# . elfs_admin
    [root@emanage ~(elfs_admin)]# 

    2. Note your DC id by running 

    [root@emanage ~(elfs_admin)]# elfs-cli data_container list -t
    id  name       uuid                                  used_capacity  namespace_scope  data_type        policy_id  dedup  compression  soft_quota  hard_quota  created_at        updated_at        exports_count  dir_permissions  dir_uid  dir_gid  tenant_id  nfs_interface  smb_interface  total_used_bytes  dc_pairs  ilm_state      ilm_error  cc_service  bucket_name...
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    4   cleartier  cb0e50ab-d5e2-483d-bb03-abc134ce1402  6.248 GB       global           general_purpose  1          0      1            1000.0 GB   1.465 TB    Feb 10, 10:43:59  Feb 10, 10:54:28  1              755              0        0        1          true           false          6.248 GB                    ilm_connected             1           cleartier-a...
    [root@emanage ~(elfs_admin)]#

    3. List the DC files and note their fullPath values

    [root@emanage ~(elfs_admin)]# elfs-cli data_container read_dir --id 4
    name       type  uid  gid  size  mode  isDirectory  fullPath    parentFullPath  cursor
    --------------------------------------------------------------------------------------
    file5.tar  2     0    0    0     0     false        /file5.tar  /
    file1.iso  2     0    0    0     0     false        /file1.iso  /
    file4.pdf  2     0    0    0     0     false        /file4.pdf  /
    file2.iso  2     0    0    0     0     false        /file2.iso  /
    file3.pdf  2     0    0    0     0     false        /file3.pdf  /
    [root@emanage ~(elfs_admin)]#

    4. Cool files manually providing their fullPath values

    [root@emanage ~(elfs_admin)]# elfs-cli data_container move_to_object --id 4 --files-list /file1.iso /file3.pdf /file5.tar
    Time: 00:03:40 |=============================================================================================================| 100% Upload data and destage files
    Completed successfully

    5. Warm files back into the primary tier

    [root@emanage ~(elfs_admin)]# elfs-cli data_container move_from_object --id 4 --files-list /file1.iso /file3.pdf /file5.tar
    Time: 00:11:40 |=============================================================================================================| 100% Warmup write and restage files
    Completed successfully




File usage in the Primary tier:

Before Cooling-

[root@client cleartier]# du -sh *
3.1G  file1.iso
1.5G  file2.iso
832K  file3.pdf
4.2M  file4.pdf
1.8G  file5.tar

[root@client cleartier]# stat *
  File: ‘file1.iso’
  Size: 3282042880  Blocks: 6365784    IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283078    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:47:27.285903626 +0200
Modify: 2019-02-10 10:48:04.529072630 +0200
Change: 2019-02-10 10:53:25.509657743 +0200

  File: ‘file2.iso’
  Size: 1596981248  Blocks: 3076024    IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283079    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:48:04.532945040 +0200
Modify: 2019-02-10 10:48:22.165989765 +0200
Change: 2019-02-10 10:53:36.127059001 +0200

  File: ‘file3.pdf’
  Size: 850327      Blocks: 1664       IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283081    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:50:05.601599490 +0200
Modify: 2019-02-10 10:50:05.635561325 +0200
Change: 2019-02-10 10:54:00.496304313 +0200

  File: ‘file4.pdf’
  Size: 4322292     Blocks: 8448       IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283083    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:50:05.667462138 +0200
Modify: 2019-02-10 10:50:05.760049879 +0200
Change: 2019-02-10 10:54:19.430789918 +0200

  File: ‘file5.tar’
  Size: 1870438400  Blocks: 3651088    IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283080    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:48:39.319554599 +0200
Modify: 2019-02-10 10:48:59.755139065 +0200
Change: 2019-02-10 10:54:40.207937328 +0200


After Cooling (You can see that the disk usage is set to 0, and also the size of the files and the used blocks using stat command)-

[root@client cleartier]# du -sh *
0  file1.iso
1.5G  file2.iso
0  file3.pdf
4.2M  file4.pdf
0  file5.tar

[root@client cleartier]# stat *
  File: ‘file1.iso’
  Size: 3282042880  Blocks: 0          IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283078    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:47:27.285903626 +0200
Modify: 2019-02-10 10:48:04.529072630 +0200
Change: 2019-02-10 10:53:25.509657743 +0200

  File: ‘file2.iso’
  Size: 1596981248  Blocks: 3076024    IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283079    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:48:04.532945040 +0200
Modify: 2019-02-10 10:48:22.165989765 +0200
Change: 2019-02-10 10:53:36.127059001 +0200

  File: ‘file3.pdf’
  Size: 850327      Blocks: 0          IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283081    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:50:05.601599490 +0200
Modify: 2019-02-10 10:50:05.635561325 +0200
Change: 2019-02-10 10:54:00.496304313 +0200

  File: ‘file4.pdf’
  Size: 4322292     Blocks: 8448       IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283083    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:50:05.667462138 +0200
Modify: 2019-02-10 10:50:05.760049879 +0200
Change: 2019-02-10 10:54:19.430789918 +0200

  File: ‘file5.tar’
  Size: 1870438400  Blocks: 0          IO Block: 1048576 regular file
Device: 2eh/46d  Inode: 49283080    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-02-10 10:48:39.319554599 +0200
Modify: 2019-02-10 10:48:59.755139065 +0200
Change: 2019-02-10 10:54:40.207937328 +0200


S
Snir is the author of this solution article.

Did you find it helpful? Yes No

Send feedback
Sorry we couldn't be helpful. Help us improve this article with your feedback.