[SOLVED] Rust implementation of read/write immutable data

happybeing · July 15, 2020, 12:00pm

I’m looking for the Maidsafe code which reads and writes immutable data - the part that handles the raw data being written through to chunking and sending to the network, and vice versa.

I tried searching for SelfEncryptor/self_encryptor in safe-api and safe-nd and built the Rust docs but am not finding the code which implemented it.

Maybe I’m searching the wrong repos or encryption isn’t used atm.

I posted an issue, but obvs Maidsafe are busy so am wondering if anyone else can point me to this post of the marriage code? Thanks.

SOLVED

I found it, see:

github.com/maidsafe/sn_data_types

support for streaming read/write of immutable data types

opened 07:05PM - 14 Jul 20 UTC

closed 02:24PM - 15 Jul 20 UTC

happybeing

enhancement

I'm looking into implementing FUSE directly on the Rust APIs and wondering what …support exists or is planned for writing and reading data that may be too large to hold in memory. I remember there were streaming r/w functions in the old SAFE NFS APIs, but am not sure if these just held the data in memory regardless. It should be relatively straightforward to do streaming read and write given the data is chunked/de-chunked in the client, but I'm struggling to find where this happens in the current libraries. I have found the SelfEncryptor which I thought would be used by any relevant code, but I can't find anything which uses it! ### Help! - So can you answer what if any streaming read/wrote support exists for immutable data, or if this is planned? - And can you point me to the code which currently generates the chunks and also where they are used to build the data map. I built the Rust docs within safe-api, but it's still quite hard to find things and see how they work together, so I'd like to look at the code which does these things and maybe I can fill in any gaps myself until the API supports sequentiall read/write (assuming that's not there yet).