commit 1a008c1

Author: Lucy Ge <[email protected]>
Date:   Mon Jun 24 15:23:06 2024 -0700

    Squashed commit of the following:

    commit 36f0ea4
    Author: Lucy Ge <[email protected]>
    Date:   Thu Dec 14 15:31:43 2023 -0800

        add test to alloc gpu mem and call readRMA, mark test ignore for now whenever there's available hardward fabric env

    commit f0ba8ac
    Author: Lucy Ge <[email protected]>
    Date:   Tue Dec 12 17:07:21 2023 -0800

        1. make LocalCacheManager.cache() available in interface
        2. allocate direct ByteBuffer and then register with UcpMemory to provide UcpMemory wrapped buffer to avoid ucx failure to allocate user mem ( mm_sysv.c:114  UCX  ERROR   failed to allocate 4096 bytes with mm for user memory )
        3. make UcxReadTest#testClientServerr do random unaligned read, and add testStandaloneServer as a sanity test for standalone UcpServer
        4. downgrade debugging logs' level from info to debug
        5. remove standalone testing process class UcpClientTest

    commit 7154d4f
    Author: Lucy Ge <[email protected]>
    Date:   Fri Dec 8 22:47:37 2023 -0800

        add getUcpMemory in wrapper cachemgr implementations

    commit 5b72806
    Author: Lucy Ge <[email protected]>
    Date:   Fri Dec 8 22:27:51 2023 -0800

        instantiate listener in start() instead of constructor

    commit 1def30d
    Author: Lucy Ge <[email protected]>
    Date:   Fri Dec 8 21:43:36 2023 -0800

        fixes for ucp server module

    commit 99eea03
    Author: Lucy Ge <[email protected]>
    Date:   Thu Dec 7 17:39:46 2023 -0800

        additonal changes to make UcpServer a module

    commit a7237fb
    Author: Lucy Ge <[email protected]>
    Date:   Thu Dec 7 13:05:14 2023 -0800

        WIP - make UcpServer a module

    commit c6cd05a
    Author: Lucy Ge <[email protected]>
    Date:   Wed Dec 6 17:19:31 2023 -0800

        stash changes - worker version using alluxioworker process to start standalone ucp server

    commit f293e49
    Author: LucyGe <[email protected]>
    Date:   Wed Dec 6 21:13:50 2023 +0000

        compile error and add start scripts for UcpServer / UcpClientTest

    commit 3a2c618
    Author: Lucy Ge <[email protected]>
    Date:   Wed Dec 6 11:04:14 2023 -0800

        stash local changes to debug stressucxbench

    commit 9bc39c5
    Author: Lucy Ge <[email protected]>
    Date:   Thu Nov 30 17:01:14 2023 -0800

        1. add cache / getUcpMemory api in CacheManager interface
        2. add error case handling in getUcpMemory
        3. add UcxConnectionPool
        4. ReadRequestRMAHandler should break without error if can't serve requested read len
        5. have UcpServer own its own cachemanager instead of relying on worker, add temporary prefill func to warm up cache
        6. fix UcxDataReader to return correct read len
        7. add StressUcxBench

    commit 4eb130b
    Author: Lucy Ge <[email protected]>
    Date:   Fri Nov 17 14:27:09 2023 -0800

        WIP - making multi-iteration read UT work

    commit c573235
    Author: Lucy Ge <[email protected]>
    Date:   Wed Nov 8 15:07:00 2023 -0800

        Initial working version of ReadRequestRMA for both client and server + add UT UcxReadTest

    commit 3a13395
    Author: Lucy Ge <[email protected]>
    Date:   Fri Nov 3 17:18:16 2023 -0700

        mv UT class

    commit 2150e4d
    Author: Lucy Ge <[email protected]>
    Date:   Fri Nov 3 17:00:05 2023 -0700

        WIP -add readRMA in reader client + add related read UT

    commit 131441d
    Author: Lucy Ge <[email protected]>
    Date:   Fri Nov 3 12:24:18 2023 -0700

        1. fixes on the buffer to send back info in accepting conn
        2. fix for UcxConnectionTest.testEstablishConnection, it's now working
        to test the UcxConnection establishment logics

    commit 653da91
    Author: Lucy Ge <[email protected]>
    Date:   Wed Nov 1 16:55:56 2023 -0700

        test file name change

    commit 5bbe0fc
    Author: Lucy Ge <[email protected]>
    Date:   Wed Nov 1 15:51:43 2023 -0700

        sort pom

    commit e0d8592
    Author: Lucy Ge <[email protected]>
    Date:   Wed Nov 1 15:47:07 2023 -0700

        compile errors

    commit 49944e2
    Author: Lucy Ge <[email protected]>
    Date:   Wed Nov 1 15:04:30 2023 -0700

        add missing files

    commit 29106a7
    Author: Lucy Ge <[email protected]>
    Date:   Wed Nov 1 15:02:41 2023 -0700

        WIP - add init new conn / accept income conn logics

    commit 2104843
    Author: Lucy Ge <[email protected]>
    Date:   Tue Oct 31 11:08:20 2023 -0700

        WIP - 1) add RMA read request handler 2) tag establishment fixes

    commit 9e2648e
    Author: Lucy Ge <[email protected]>
    Date:   Wed Oct 25 21:38:02 2023 -0700

        WIP - basic skeleton

    commit c4206be
    Author: Lucy Ge <[email protected]>
    Date:   Mon Oct 23 10:22:48 2023 -0700

        add missing file in refactoring

    commit 2928a78
    Author: Lucy Ge <[email protected]>
    Date:   Mon Oct 23 10:10:18 2023 -0700

        WIP - refactor

    commit 2e7950b
    Author: Lucy Ge <[email protected]>
    Date:   Wed Oct 18 16:21:13 2023 -0700

        worker end-to-end read workflow version of ucpserver/ucxDataReader

    commit f443ec6
    Author: Lucy Ge <[email protected]>
    Date:   Wed Oct 11 16:45:50 2023 -0700

        WIP:
        1. req sendTagged and recvTagged should have same buffersize
        2. use different tag for different client inetaddr
        3. start recvReq on accepting conn on server side, and keep recvReq for
        the same client one after another

    commit 37ee296
    Author: Lucy Ge <[email protected]>
    Date:   Tue Oct 10 21:21:37 2023 -0700

        WIP - add UcpServer / UcpClientTest standalone main()

    commit 9d58cc4
    Author: Lucy Ge <[email protected]>
    Date:   Mon Oct 9 14:54:57 2023 -0700

        WIP -
        1. use correct dependency in pom
        2. add test to initially test client/server

    commit 3d5c353
    Author: Lucy Ge <[email protected]>
    Date:   Fri Oct 6 12:37:37 2023 -0700

        use abs path from local for now

    commit 95a69e0
    Author: Lucy Ge <[email protected]>
    Date:   Tue Sep 19 14:17:39 2023 -0700

        jar change

    commit 1472081
    Author: Lucy Ge <[email protected]>
    Date:   Tue Sep 19 14:01:03 2023 -0700

        ucp server/client WIP

common/transport/src/main/proto/proto/dataserver/protocol.proto

@@ -12,6 +12,27 @@ enum RequestType {
   UFS_FILE = 1;
 }
 
+// The rma read request.
+// next available id: 10
+message ReadRequestRMA {
+  optional int64 block_id = 1;
+  optional int64 offset = 2;
+  optional int64 length = 3;
+  // If set, this request is to cancel the reading request for the id.
+  optional bool cancel = 4;
+  // Whether the block should be promoted before reading
+  optional bool promote = 7;
+
+  // If set, the server should send packets in the specified packet size.
+  optional int64 chunk_size = 5;
+
+  // This is only set for UFS block read.
+  optional OpenUfsBlockOptions open_ufs_block_options = 6;
+
+  required int64 remote_mem_addr = 8;
+  required bytes rkey_buf = 9;
+}
+
 // The read request.
 // next available id: 8
 message ReadRequest {
@@ -97,6 +118,11 @@ message ReadResponse {
   optional Type type = 1;
 }
 
+message ReadResponseRMA {
+  required int64 read_length = 1;
+  optional string error_msg = 2;
+}
+
 // A heartbeat
 message Heartbeat {
   // Empty message

conf/log4j.properties

@@ -115,6 +115,23 @@ log4j.appender.FUSE_LOGGER.MaxBackupIndex=10
 log4j.appender.FUSE_LOGGER.layout=org.apache.log4j.PatternLayout
 log4j.appender.FUSE_LOGGER.layout.ConversionPattern=%d{ISO8601} %-5p [%t](%F:%L) - %m%n
 
+#ucpserver
+log4j.appender.UCPSERVER_LOGGER=org.apache.log4j.RollingFileAppender
+log4j.appender.UCPSERVER_LOGGER.File=${alluxio.logs.dir}/ucpserver.log
+log4j.appender.UCPSERVER_LOGGER.MaxFileSize=10MB
+log4j.appender.UCPSERVER_LOGGER.MaxBackupIndex=100
+log4j.appender.UCPSERVER_LOGGER.layout=org.apache.log4j.PatternLayout
+log4j.appender.UCPSERVER_LOGGER.layout.ConversionPattern=%d{ISO8601} %-5p [%t](%F:%L) - %m%n
+
+#ucpclienttest
+log4j.appender.UCPCLIENTTEST_LOGGER=org.apache.log4j.RollingFileAppender
+log4j.appender.UCPCLIENTTEST_LOGGER.File=${alluxio.logs.dir}/ucpclienttest.log
+log4j.appender.UCPCLIENTTEST_LOGGER.MaxFileSize=10MB
+log4j.appender.UCPCLIENTTEST_LOGGER.MaxBackupIndex=100
+log4j.appender.UCPCLIENTTEST_LOGGER.layout=org.apache.log4j.PatternLayout
+log4j.appender.UCPCLIENTTEST_LOGGER.layout.ConversionPattern=%d{ISO8601} %-5p [%t](%F:%L) - %m%n
+
+
 # Disable noisy DEBUG logs
 log4j.logger.com.amazonaws.util.EC2MetadataUtils=OFF
 log4j.logger.io.grpc.netty.NettyServerHandler=OFF

conf/start-ucp-server.sh

@@ -0,0 +1,3 @@
+#!/bin/bash
+
+java -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=60003 -cp /root/github/alluxio/conf/::/root/github/alluxio/assembly/server/target/alluxio-assembly-server-305-SNAPSHOT-jar-with-dependencies.jar -Dalluxio.logger.type=UCPSERVER_LOGGER -Dalluxio.home=/root/github/alluxio -Dalluxio.conf.dir=/root/github/alluxio/conf -Dalluxio.logs.dir=/root/github/alluxio/logs -Dalluxio.user.logs.dir=/root/github/alluxio/logs/user -Dlog4j.configuration=file:/root/github/alluxio/conf/log4j.properties -Dorg.apache.jasper.compiler.disablejsr199=true -Djava.net.preferIPv4Stack=true -Xmx4g -XX:MaxDirectMemorySize=4g alluxio.worker.ucx.UcpServer 10 /root/testfolder 1 2&>1 > /root/github/alluxio/logs/ucpserver.out &

dora/core/client/fs/pom.xml

@@ -85,6 +85,10 @@
       <artifactId>alluxio-core-transport</artifactId>
       <version>${project.version}</version>
     </dependency>
+    <dependency>
+      <groupId>org.openucx</groupId>
+      <artifactId>jucx</artifactId>
+    </dependency>
     <dependency>
       <groupId>org.rocksdb</groupId>
       <artifactId>rocksdbjni</artifactId>

dora/core/client/fs/src/main/java/alluxio/client/file/cache/CacheManager.java

@@ -23,6 +23,7 @@
 import alluxio.resource.LockResource;
 
 import com.codahale.metrics.Counter;
+import org.openucx.jucx.ucp.UcpMemory;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
@@ -35,6 +36,7 @@
 import java.util.concurrent.locks.ReentrantLock;
 import java.util.function.Predicate;
 import java.util.function.Supplier;
+import javax.annotation.Nullable;
 import javax.annotation.concurrent.GuardedBy;
 
 /**
@@ -89,12 +91,24 @@ class Factory {
      *         case creation takes a long time by other threads.
      */
     public static CacheManager get(AlluxioConfiguration conf) throws IOException {
+      CacheManagerOptions options = CacheManagerOptions.create(conf);
+      return get(conf, options, PageMetaStore.create(options));
+    }
+
+    /**
+     * @param conf the Alluxio configuration
+     * @return current CacheManager handle, creating a new one if it doesn't yet exist or null in
+     *         case creation takes a long time by other threads.
+     */
+    public static CacheManager get(AlluxioConfiguration conf,
+                                   CacheManagerOptions options,
+                                   PageMetaStore pageMetaStore) throws IOException {
       // TODO(feng): support multiple cache managers
       if (CACHE_MANAGER.get() == null) {
         try (LockResource lockResource = new LockResource(CACHE_INIT_LOCK)) {
           if (CACHE_MANAGER.get() == null) {
             CACHE_MANAGER.set(
-                create(conf));
+                create(conf, options, pageMetaStore));
           }
         } catch (IOException e) {
           Metrics.CREATE_ERRORS.inc();
@@ -104,15 +118,6 @@ public static CacheManager get(AlluxioConfiguration conf) throws IOException {
       return CACHE_MANAGER.get();
     }
 
-    /**
-     * @param conf the Alluxio configuration
-     * @return an instance of {@link CacheManager}
-     */
-    public static CacheManager create(AlluxioConfiguration conf) throws IOException {
-      CacheManagerOptions options = CacheManagerOptions.create(conf);
-      return create(conf, options, PageMetaStore.create(options));
-    }
-
     /**
      * @param conf the Alluxio configuration
      * @param options the options for local cache manager
@@ -306,6 +311,10 @@ int get(PageId pageId, int pageOffset, int bytesToRead, ReadTargetBuffer buffer,
   int getAndLoad(PageId pageId, int pageOffset, int bytesToRead,
       ReadTargetBuffer buffer, CacheContext cacheContext, Supplier<byte[]> externalDataSupplier);
 
+  default int cache(PageId pageId, CacheContext cacheContext, Supplier<byte[]> externalDataSupplier) {
+    throw new UnsupportedOperationException();
+  }
+
   /**
    * Get page ids by the given file id.
    * @param fileId file identifier
@@ -381,4 +390,9 @@ default void invalidate(Predicate<PageInfo> predicate) {
   Optional<DataFileChannel> getDataFileChannel(
       PageId pageId, int pageOffset, int bytesToRead, CacheContext cacheContext)
       throws PageNotFoundException;
+
+  default Optional<UcpMemory> getUcpMemory(PageId pageId, int pageOffset, int bytesToRead)
+      throws PageNotFoundException, IOException {
+    throw new UnsupportedOperationException();
+  }
 }

dora/core/client/fs/src/main/java/alluxio/client/file/cache/CacheManagerWithShadowCache.java

@@ -26,7 +26,9 @@
 import com.google.common.annotations.VisibleForTesting;
 import com.google.common.hash.Funnel;
 import com.google.common.hash.PrimitiveSink;
+import org.openucx.jucx.ucp.UcpMemory;
 
+import java.io.IOException;
 import java.nio.ByteBuffer;
 import java.util.Optional;
 import java.util.function.Supplier;
@@ -61,13 +63,24 @@ public boolean put(PageId pageId, ByteBuffer page, CacheContext cacheContext) {
     return mCacheManager.put(pageId, page, cacheContext);
   }
 
+  @Override
+  public int cache(PageId pageId, CacheContext cacheContext, Supplier<byte[]> externalDataSupplier) {
+    return mCacheManager.cache(pageId, cacheContext, externalDataSupplier);
+  }
+
   @Override
   public int get(PageId pageId, int pageOffset, int bytesToRead, ReadTargetBuffer target,
       CacheContext cacheContext) {
     getOrUpdateShadowCache(pageId, bytesToRead, cacheContext);
     return mCacheManager.get(pageId, pageOffset, bytesToRead, target, cacheContext);
   }
 
+  @Override
+  public Optional<UcpMemory> getUcpMemory(PageId pageId, int pageOffset, int bytesToRead)
+      throws PageNotFoundException, IOException {
+    return mCacheManager.getUcpMemory(pageId, pageOffset, bytesToRead);
+  }
+
   @Override
   public int getAndLoad(PageId pageId, int pageOffset, int bytesToRead,
       ReadTargetBuffer buffer, CacheContext cacheContext, Supplier<byte[]> externalDataSupplier) {

dora/core/client/fs/src/main/java/alluxio/client/file/cache/LocalCacheManager.java

@@ -20,6 +20,7 @@
 import static java.util.concurrent.TimeUnit.SECONDS;
 
 import alluxio.client.file.CacheContext;
+import alluxio.client.file.cache.store.LocalPageStore;
 import alluxio.client.file.cache.store.PageStoreDir;
 import alluxio.client.quota.CacheQuota;
 import alluxio.client.quota.CacheScope;
@@ -38,6 +39,7 @@
 import com.codahale.metrics.Counter;
 import com.google.common.annotations.VisibleForTesting;
 import com.google.common.base.Preconditions;
+import org.openucx.jucx.ucp.UcpMemory;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
@@ -582,6 +584,26 @@ public int get(PageId pageId, int pageOffset, ReadTargetBuffer buffer,
     return get(pageId, pageOffset, (int) pageSize, buffer, cacheContext);
   }
 
+  @Override
+  public Optional<UcpMemory> getUcpMemory(PageId pageId, int pageOffset, int bytesToRead)
+      throws PageNotFoundException, IOException {
+    if (mState.get() == NOT_IN_USE) {
+      Metrics.GET_NOT_READY_ERRORS.inc();
+      Metrics.GET_ERRORS.inc();
+      return Optional.empty();
+    }
+    PageInfo pageInfo;
+    try (LockResource r2 = new LockResource(mPageMetaStore.getLock().readLock())) {
+      pageInfo = mPageMetaStore.getPageInfo(pageId); //check if page exists and refresh LRU items
+    } catch (PageNotFoundException e) {
+      LOG.debug("get({},pageOffset={}) fails due to page not found", pageId, pageOffset);
+      throw e;
+    }
+    UcpMemory ucpMemory = ((LocalPageStore)(pageInfo.getLocalCacheDir().getPageStore()))
+        .get(pageId, false, pageOffset, bytesToRead);
+    return Optional.of(ucpMemory);
+  }
+
   @Override
   public int get(PageId pageId, int pageOffset, int bytesToRead, ReadTargetBuffer buffer,
                  CacheContext cacheContext) {
@@ -632,6 +654,24 @@ public int get(PageId pageId, int pageOffset, int bytesToRead, ReadTargetBuffer
     }
   }
 
+  public int cache(PageId pageId, CacheContext cacheContext, Supplier<byte[]> externalDataSupplier) {
+    int bytesCached = 0;
+    long startTime = System.nanoTime();
+    byte[] page = externalDataSupplier.get();
+    long timeElapse = System.nanoTime() - startTime;
+    MetricsSystem.meter(MetricKey.CLIENT_CACHE_BYTES_REQUESTED_EXTERNAL.getName())
+        .mark(bytesCached);
+    MetricsSystem.counter(MetricKey.CLIENT_CACHE_EXTERNAL_REQUESTS.getName()).inc();
+    cacheContext.incrementCounter(
+        MetricKey.CLIENT_CACHE_BYTES_REQUESTED_EXTERNAL.getMetricName(), BYTE,
+        bytesCached);
+    cacheContext.incrementCounter(
+        MetricKey.CLIENT_CACHE_PAGE_READ_EXTERNAL_TIME_NS.getMetricName(), NANO,
+        timeElapse);
+    put(pageId, page, cacheContext);
+    return bytesCached;
+  }
+
   @Override
   public int getAndLoad(PageId pageId, int pageOffset, int bytesToRead, ReadTargetBuffer buffer,
                         CacheContext cacheContext, Supplier<byte[]> externalDataSupplier) {

dora/core/client/fs/src/main/java/alluxio/client/file/cache/NoExceptionCacheManager.java

@@ -19,9 +19,11 @@
 import alluxio.network.protocol.databuffer.DataFileChannel;
 
 import com.codahale.metrics.Counter;
+import org.openucx.jucx.ucp.UcpMemory;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
+import java.io.IOException;
 import java.nio.ByteBuffer;
 import java.util.List;
 import java.util.Optional;
@@ -73,6 +75,11 @@ public boolean put(PageId pageId, ByteBuffer page, CacheContext cacheContext) {
     }
   }
 
+  @Override
+  public int cache(PageId pageId, CacheContext cacheContext, Supplier<byte[]> externalDataSupplier) {
+    return mCacheManager.cache(pageId, cacheContext, externalDataSupplier);
+  }
+
   @Override
   public int get(PageId pageId, int pageOffset, ReadTargetBuffer buffer,
                  CacheContext cacheContext) {
@@ -143,6 +150,12 @@ public int get(PageId pageId, int pageOffset, int bytesToRead, ReadTargetBuffer
     }
   }
 
+  @Override
+  public Optional<UcpMemory> getUcpMemory(PageId pageId, int pageOffset, int bytesToRead)
+      throws PageNotFoundException, IOException {
+    return mCacheManager.getUcpMemory(pageId, pageOffset, bytesToRead);
+  }
+
   @Override
   public int getAndLoad(PageId pageId, int pageOffset, int bytesToRead,
       ReadTargetBuffer buffer, CacheContext cacheContext,

dora/core/client/fs/src/main/java/alluxio/client/file/cache/store/LocalPageStore.java

@@ -12,6 +12,7 @@
 package alluxio.client.file.cache.store;
 
 import static alluxio.client.file.cache.store.PageStoreDir.getFileBucket;
+import static java.nio.file.StandardOpenOption.READ;
 
 import alluxio.client.file.cache.PageId;
 import alluxio.client.file.cache.PageStore;
@@ -23,13 +24,20 @@
 import com.google.common.annotations.VisibleForTesting;
 import com.google.common.base.Preconditions;
 import org.apache.commons.io.FileUtils;
+import org.openucx.jucx.UcxUtils;
+import org.openucx.jucx.ucp.UcpContext;
+import org.openucx.jucx.ucp.UcpMemMapParams;
+import org.openucx.jucx.ucp.UcpMemory;
+import org.openucx.jucx.ucp.UcpParams;
 
 import java.io.File;
 import java.io.FileNotFoundException;
 import java.io.FileOutputStream;
 import java.io.IOException;
 import java.io.RandomAccessFile;
 import java.nio.ByteBuffer;
+import java.nio.MappedByteBuffer;
+import java.nio.channels.FileChannel;
 import java.nio.file.DirectoryStream;
 import java.nio.file.Files;
 import java.nio.file.NoSuchFileException;
@@ -199,6 +207,37 @@ public Path getPagePath(PageId pageId, boolean isTemporary) {
     return filePath.resolve(Long.toString(pageId.getPageIndex()));
   }
 
+  public static final UcpContext sGlobalContext = new UcpContext(new UcpParams()
+        .requestStreamFeature()
+        .requestTagFeature()
+        .requestWakeupFeature());
+  public UcpMemory get(PageId pageId, boolean isTemporary,
+                       int pageOffset, int bytesToRead)
+      throws IOException, PageNotFoundException {
+    Preconditions.checkArgument(pageOffset >= 0,
+        "page offset should be non-negative");
+    Path pagePath = getPagePath(pageId, isTemporary);
+    File pageFile = pagePath.toFile();
+    if (!pageFile.exists()) {
+      throw new PageNotFoundException(pagePath.toString());
+    }
+    FileChannel fileChannel = FileChannel.open(pagePath, READ);
+    LOG.error("open fc for:{}:pageOffset:{}:bytesToRead:{}",
+        pagePath, pageOffset, bytesToRead);
+    long fileLength = pageFile.length();
+    if (pageOffset + bytesToRead > fileLength) {
+      bytesToRead = (int) (fileLength - (long) pageOffset);
+    }
+    // TODO set mem pool here
+    MappedByteBuffer buf = fileChannel.map(FileChannel.MapMode.READ_ONLY,
+        pageOffset, bytesToRead);
+    UcpMemory mmapedMemory = sGlobalContext.memoryMap(new UcpMemMapParams()
+        .setAddress(UcxUtils.getAddress(buf))
+        .setLength(bytesToRead).nonBlocking());
+    return mmapedMemory;
+  }
+
+
   @Override
   public DataFileChannel getDataFileChannel(
       PageId pageId, int pageOffset, int bytesToRead, boolean isTemporary)

dora/core/client/fs/src/main/java/alluxio/client/file/cache/store/PageStoreOptions.java

@@ -15,6 +15,7 @@
 import alluxio.conf.PropertyKey;
 import alluxio.util.FormatUtils;
 
+import com.google.common.base.MoreObjects;
 import com.google.common.base.Preconditions;
 
 import java.nio.file.Path;
@@ -296,4 +297,15 @@ public PageStoreOptions setStoreType(PageStoreType storeType) {
     mStoreType = storeType;
     return this;
   }
+
+  @Override
+  public String toString() {
+    return MoreObjects.toStringHelper(this)
+        .add("rootdir", mRootDir.toAbsolutePath().toString())
+        .add("index", mIndex)
+        .add("alluxioversion", mAlluxioVersion)
+        .add("pagesize", mPageSize)
+        .add("cachesize", mCacheSize)
+        .toString();
+  }
 }