Supported Features

With "weed mount", the files can be operated as a local file. The following operations are supported.

  • file read / write
  • create new file
  • mkdir
  • list
  • remove
  • rename
  • chmod
  • chown
  • soft link
  • display free disk space

Mount as FUSE

This uses seaweedfs/fuse, which enables writing FUSE file systems on Linux and OS X. On OS X, it requires OSXFUSE (http://osxfuse.github.com/).

  1. # assuming you already started weed master, weed volume and filer
  2. weed mount -filer=localhost:8888 -dir=/some/existing/dir -filer.path=/one/remote/folder
  3. weed mount -filer=localhost:8888 -dir=/some/existing/dir -filer.path=/
  4. # example: mount one collection and a folder to a local directory
  5. weed mount -filer=localhost:8888 -dir=~/folder_on_seaweedfs -filer.path=/home/chris -collection=chris

Now you can operate the SeaweedFS files, browsing or modifying directories and files, in local file system.To unmount, just shut it down the "weed mount".

Weed Mount Architecture

"weed mount" has a persistent client connecting to Master, to get the location updates of all volumes.There are no network round trip to lookup the volume id location.

For reads:

  • Client Reads File Metadata => Weed Filer => Weed Filer database (LevelDB, Cassandra, Redis, Mysql, Postgres, etc)
  • Client Reads File Chunks => Weed Volume ServersMount - 图1

For writes:

  • Client uploads data to Weed Volume Servers, and breaks the large files into chunks.
  • Client writes the metadata and chunk information into Filer and then into Filer database.Mount - 图2

Weed Mount Performance Benchmark

"sysbench" is used here. If you have better benchmarking tools, please share your results.

  1. $ brew install sysbench
  2. $ cd /a/mounted/folder
  3. $ sysbench --test=fileio --file-total-size=1G prepare
  5. $ sysbench --test=fileio --file-total-size=1G --file-test-mode=rndrw --max-time=300 --max-requests=0 --num-threads=1 run
  6. WARNING: the --test option is deprecated. You can pass a script name or path on the command line without any options.
  7. WARNING: --max-time is deprecated, use --time instead
  8. sysbench 1.0.15 (using bundled LuaJIT 2.1.0-beta2)
  10. Running the test with following options:
  11. Number of threads: 1
  12. Initializing random number generator from current time
  15. Extra file open flags: (none)
  16. 128 files, 8MiB each
  17. 1GiB total file size
  18. Block size 16KiB
  19. Number of IO requests: 0
  20. Read/Write ratio for combined random IO test: 1.50
  21. Periodic FSYNC enabled, calling fsync() each 100 requests.
  22. Calling fsync() at the end of test, Enabled.
  23. Using synchronous I/O mode
  24. Doing random r/w test
  25. Initializing worker threads...
  27. Threads started!
  30. File operations:
  31.     reads/s:                      1246.96
  32.     writes/s:                     831.31
  33.     fsyncs/s:                     2660.22
  35. Throughput:
  36.     read, MiB/s:                  19.48
  37.     written, MiB/s:               12.99
  39. General statistics:
  40.     total time:                          300.0036s
  41.     total number of events:              1421441
  43. Latency (ms):
  44.          min:                                    0.00
  45.          avg:                                    0.21
  46.          max:                                  175.59
  47.          95th percentile:                        0.84
  48.          sum:                               298364.02
  50. Threads fairness:
  51.     events (avg/stddev):           1421441.0000/0.00
  52.     execution time (avg/stddev):   298.3640/0.00

The above is single-threaded. The following uses 32 threads.

  1. $ sysbench --test=fileio --file-total-size=1G --file-test-mode=rndrw --max-time=300 --max-requests=0 --num-threads=32 run
  2. WARNING: the --test option is deprecated. You can pass a script name or path on the command line without any options.
  3. WARNING: --num-threads is deprecated, use --threads instead
  4. WARNING: --max-time is deprecated, use --time instead
  5. sysbench 1.0.15 (using bundled LuaJIT 2.1.0-beta2)
  7. Running the test with following options:
  8. Number of threads: 32
  9. Initializing random number generator from current time
  12. Extra file open flags: (none)
  13. 128 files, 8MiB each
  14. 1GiB total file size
  15. Block size 16KiB
  16. Number of IO requests: 0
  17. Read/Write ratio for combined random IO test: 1.50
  18. Periodic FSYNC enabled, calling fsync() each 100 requests.
  19. Calling fsync() at the end of test, Enabled.
  20. Using synchronous I/O mode
  21. Doing random r/w test
  22. Initializing worker threads...
  24. Threads started!
  27. File operations:
  28.     reads/s:                      7704.72
  29.     writes/s:                     5136.55
  30.     fsyncs/s:                     16450.24
  32. Throughput:
  33.     read, MiB/s:                  120.39
  34.     written, MiB/s:               80.26
  36. General statistics:
  37.     total time:                          300.0279s
  38.     total number of events:              8784212
  40. Latency (ms):
  41.          min:                                    0.00
  42.          avg:                                    1.09
  43.          max:                                  188.01
  44.          95th percentile:                        5.00
  45.          sum:                              9582443.42
  47. Threads fairness:
  48.     events (avg/stddev):           274506.6250/1270.81
  49.     execution time (avg/stddev):   299.4514/0.00

Common Problems

Unmount

Sometimes weed mount can not start if the last mount process was not cleaned up.

You can clean up with these commands. Try any of them until it works:

  1. // on mac
  2. sudo umount /the/mounted/dir
  3. diskutil unmount force /the/mounted/dir
  4. sudo umount -f /the/mounted/dir
  5. sudo umount -l /the/mounted/dir
  7. // on linux
  8. sudo umount -f /the/mounted/dir
  9. sudo umount -l /the/mounted/dir

Still fail to mount on MacOS

From https://github.com/osxfuse/osxfuse/issues/358

FUSE needs to register a virtual device for exchanging messages between the kernel and the actual file system implementation running in user space. The number of available device slots is limited by macOS. So if you are using other software like VMware, VirtualBox, TunTap, Intel HAXM, …, that eat up all free device slots, FUSE will not be able to register its virtual device.

Samba share mounted folder

From https://github.com/chrislusf/seaweedfs/issues/936The issue is with samba.conf. If you see NT_STATUS_ACCESS_DENIED error, try to add force user and force group to your samba.conf file.

  1. [profiles]
  2.    comment = Users profiles
  3.    path = /home/chris/mm
  4.    guest ok = yes
  5.    browseable = yes
  6.    create mask = 0775
  7.    directory mask = 0775
  8.    force user = root
  9.    force group = root