337 Commits

Author SHA1 Message Date
Ericson Soares
6a69f5f8ef Update sync messages push and pull
Also fix scalability issues on sync design
2024-10-19 02:48:27 -03:00
Ericson Soares
2bb06d6317 Many tweaks to improve sync responsiveness and observability 2024-10-14 23:39:52 -03:00
James Pine
0ac05f46b3 increase max file size for thubm generation 2024-10-12 00:59:27 -07:00
Ericson Soares
375c111305 Some tweaks on sync messages encryption and decryption 2024-10-09 22:04:49 -03:00
Ericson Soares
3208ef5dd2 Change database to use device id on everything instead of pub_id 2024-10-07 22:38:45 -03:00
Vítor Vasconcellos
a223fa0a8b Merge remote-tracking branch 'origin/main' into eng-1828-migration-to-new-cloud-api-system 2024-10-06 23:36:06 -03:00
Vítor Vasconcellos
cdc50140b0 [ENG-1928] Update to tauri 2.0.1 stable (#2752)
* Update to tauri 2.0.0 stable
 - Update a some othe dependencies
 - Autoformat rust and toml files

* Fix clippy complain

* Update tauri 2.0.1
 - Update rspc
 - Update some frontend files due changes in rspc
 - Update some frontend build dependencies

* Revert babel update

* Fix code typing typing and style + a couple of bugs

* More type fixes
2024-10-05 21:17:30 +00:00
Arnab Chakraborty
2c0d94abc4 Merge branch 'main' into eng-1828-migration-to-new-cloud-api-system 2024-10-03 22:23:31 -04:00
Consoli
8ce9f30121 Remove dependency on once_cell and use std types (#2746)
* Remove dependency on once_cell and use std types

* Bump MSRV across the project to 1.81

* Cargo fmt

* Update rust-toolchain to 1.81
2024-09-30 21:19:59 +00:00
Ericson Soares
70ea030c97 Rust fmt 2024-09-29 02:08:59 -03:00
Ericson "Fogo" Soares
3a97ede562 Update toolchain and fix a bunch of warnings 2024-09-27 00:38:48 -03:00
Ericson Soares
d0e52a4342 Fix identifier bug 2024-09-19 22:02:32 -03:00
Arnab Chakraborty
ac07f001ac Merge branch 'main' into eng-1828-migration-to-new-cloud-api-system 2024-09-18 22:30:54 -04:00
Consoli
874a268735 Update pdfium-render version (#2701)
* Revert "Fix pdf thumbnails (#2666)"

This reverts commit c240047e0538f72a572fdf16f5143edf11bf1894.

* Bump pdfium-render dep

* Bring back custom fork
 - Bump the minimum pdfium lib api version (updated bundled lib in native-deps)
 - Custom fork is still required because upstream added a hard limit on chono version 0.4.31, which is incompatible with some of our dependencies which require newer versions

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
2024-09-17 14:44:03 +00:00
Ericson Soares
03e9de497b Fix key size mismatch between opaque and sd_crypto 2024-09-13 12:54:36 -03:00
Ericson Soares
9f8005c479 Relating tables to device 2024-09-06 23:53:35 -03:00
Arnab Chakraborty
02e4bf4d5b Iterator for CompressedCRDTOperationsPerModel 2024-09-06 21:01:54 -04:00
Ericson Soares
0ac38b6845 Tweak crdt ops compression and use it on cloud sync 2024-09-06 21:18:22 -03:00
Ericson Soares
872ca1deec Receiver actor for cloud sync 2024-09-04 01:50:22 -03:00
Ericson Soares
25f0f4fb1a Sender actor for cloud sync messages 2024-08-30 03:34:03 -03:00
Ericson Soares
76cba5226d More tweaks on sync subcrate and other fixes 2024-08-27 23:45:05 -03:00
Ericson Soares
4bf8db02f7 Make core compile again 2024-08-27 17:01:42 -03:00
Ericson Soares
a068ca7c7b Some tweks to simplify sync subcrate
Initial work to port cloud sync system to new cloud services
2024-08-23 23:42:51 -03:00
Ericson Soares
35c4b1549c Cloud P2P abstraction 2024-08-23 15:43:43 -03:00
Ericson Soares
111592c9a0 Cloud Key Manager 2024-08-19 19:10:05 -03:00
Ericson Soares
9bf9294471 Token refresher 2024-08-17 16:29:14 -03:00
Arnab Chakraborty
026bfeac4a Merge branch 'main' into eng-1828-migration-to-new-cloud-api-system 2024-08-17 18:40:09 +03:00
Consoli
9e09d92f03 [ENG-1159] Report progress when copying files (#2538)
* Copy ephemeral files by chunks

* Improving buffered writer

* Report progress

* Copy and emit progress as two separated tasks

* Simplify for-if-return with `Iterator::any`

* Docs and use structured tracing

* Simplify code using paths

* wip

* wip

* wip

* wip

* Add report of messages while copying files

* Add info field to job report

* Group paths from OldFileCopierJobStep into a single struct

* Improve progress information

* Remove the need for synchronization

* Error handling for copy

* Clean up frontend

* Make watcher only consider new files

* Fix concurrent renaming of multiple files that have the same name

* Add documentation for file strategist

* Remove editions to ephemeral file copies

* Remove experimental/nightly features from Cargo.toml

* Fix no-case-declarations

* Remove dead comments

* Format code

* Use "Duplicate" instead of "Copy" in the frontend messages

* Remove inline always to make clippy happy

* icons for deleter and copier

* Fix JobManager for copy jobs
 - Fix some types definitions

* Fix Job icon choosing logic
 - Fix Copier job showing two progress bars

* Log which files are not formatted in the Type and style check CI

* fmt

* Forgot an import

* autoformat

---------

Co-authored-by: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
2024-08-17 02:00:59 +00:00
Arnab Chakraborty
9ce5426b4b Merge branch 'main' into eng-1828-migration-to-new-cloud-api-system 2024-08-17 02:11:09 +03:00
Arnab Chakraborty
9366122c00 Merge branch 'main' into eng-1828-migration-to-new-cloud-api-system 2024-08-17 00:37:56 +03:00
Vítor Vasconcellos
c240047e05 Fix pdf thumbnails (#2666) 2024-08-16 21:19:19 +00:00
Vítor Vasconcellos
3675675d31 Fix prisma generate & Windows compilation (#2663)
* Ensure prisma generation works before continuing CI
 - Add script that list all dependencies with multiple version in Cargo.lock

* Ensure CI runs when custom actions are modified

* Rever windows change in hopes that it fixes prisma generation

* Fix prisma generation check in CI

* Update deps

* Replace prisma-client-rust-cli with oficial prisma cli to fix windows model generation
 - Revert back to windows-rs implementation of get_inode in file-path-helper
 - Adjust Github CI to use oficial prisma cli
 - Update scripts dependencies
 - Fix some new rust warnings due to it trying to compile OS specific code on all plataforms

* Fix windows-rs impl for get_inode_windows in file-path-helper

* More fixes to windows-rs impl for get_inode_windows in file-path-helper

* More fixes to windows-rs impl for get_inode_windows in file-path-helper

* More fixes to windows-rs impl for get_inode_windows in file-path-helper

* More fixes to windows-rs impl for get_inode_windows in file-path-helper

* More fixes to windows-rs impl for get_inode_windows in file-path-helper

* Import windows constant intead of hardcoding its value

* Fix check for prisma files in setup-rust

* Autoformat

* Fix iOS and Android targets in watcher

---------

Co-authored-by: Arnab Chakraborty <11457760+Rocky43007@users.noreply.github.com>
2024-08-16 10:55:38 +00:00
Vítor Vasconcellos
901aa4c665 Merge remote-tracking branch 'origin/main' into eng-1828-migration-to-new-cloud-api-system 2024-08-15 18:16:13 -03:00
Vítor Vasconcellos
df1f503867 Remove unused code and update rust deps (#2662)
* Remove deps-generator app
 - It is broken for quite a while and not being used

* Remove unused code and unused deps

* auto format

* Restore incorrectly removed files
 - Remove aws deps and test code using it

* Replace winapi-util with windows-rs
 - Adjust some deps versions

* Autoformat

* Update rand, remove unused dep

* Fix image crate due to changes in pdf-renderer
 - Dont use default features in reqwest
 - Use native-tls tauri

* Remove incorrect notice about blake3
2024-08-15 17:09:03 +00:00
Ericson "Fogo" Soares
8482ed59b0 Crypto revamp (#2660)
* Revamping crypto subcrate

* Merge with main

* More tweaks on crypto crate

* Remove some unsused crypto references

* Fix crypto erase example
2024-08-15 06:35:26 +00:00
Ericson Soares
108aa04899 Fix crypto erase example 2024-08-15 00:50:36 -03:00
Ericson Soares
3f4d18fd9c More tweaks on crypto crate 2024-08-15 00:46:40 -03:00
Ericson Soares
3b9acc9fe2 Merge with main 2024-08-14 17:50:39 -03:00
Ericson Soares
0cf6f278eb Revamping crypto subcrate 2024-08-14 16:51:16 -03:00
Arnab Chakraborty
8cfbd374e3 [ENG-1854] Migrate to Tauri v2 Release Candidate (#2654)
* Migrate to Tauri v2 Release Canidate

* Formatting

* Update pnpm

* Update all tauri deps (js and rust) to Release Candidate 2
 - A lot of misc fixes due to changes in the new versions of tauri, rspc and specta

* Recreate pnpm-lock

* Fix pnpm-lock

* Formatting

* Use 10 chars SHA for git deps
 - Update a couple of rust dependencies
 - Add taplo for toml auto formatting
 - Adjust some formatting configurations
 - Updated prettier and its plugins

* Fix formatter settings

* Minor improvements to Cargo.toml format

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
2024-08-14 18:22:46 +00:00
Arnab Chakraborty
54b72a7015 More merge fixes 2024-08-13 14:08:13 +03:00
Arnab Chakraborty
e80fd01dfc Merge branch 'rocky/tauri-v2-rc' into eng-1828-migration-to-new-cloud-api-system 2024-08-13 13:51:52 +03:00
Vítor Vasconcellos
d52dac2f19 Use 10 chars SHA for git deps
- Update a couple of rust dependencies
 - Add taplo for toml auto formatting
 - Adjust some formatting configurations
 - Updated prettier and its plugins
2024-08-12 17:49:31 -03:00
Arnab Chakraborty
e2d1862766 Migrate all cloud routes to the new API system
All cloud routes are now migrated to the new system in the backend.

The old routes are still available, as the frontend has not been modified to use the new ones yet.
2024-08-07 17:55:22 +03:00
Ericson Soares
8718de0928 Some new abstractions and tweaks to develop cloud services calls 2024-08-07 03:21:01 -03:00
Ericson Soares
fe6efaa4e4 Setup client for Cloud Services in Node 2024-08-02 18:53:29 -03:00
Arnab Chakraborty
3bbbf779fe Update to vite ^5.2.0 (#2645)
Fixes weird binary issue with esbuild versions clashing across deps.
2024-07-30 16:39:31 +00:00
Ericson "Fogo" Soares
2d19fad2eb [ENG-1793] Introduce error handling for sd-core-sync crate (#2556)
* Error handling for sd-core-sync crate
Also a bunch of tweaks and fixes

* Update core.ts

* Auto format

* Comment out background_processing_percentage on frontend too
 - Update rust version in contributing

* Trying to avoid data loss on actor stop

* Stronger linter on sync generator

* Stronger lint on sync subcrate

* Clean back tasks.json file

* TS typechecking

* Autoformat

* Add more verbose errors for Cloud REST API

* Removing some comments

Copilot is fun sometimes lol

* Properly stopping actors

* Fix ingest stop

* Racing on stop for actors

* Error conversion from merge with main

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Co-authored-by: Arnab Chakraborty <11457760+Rocky43007@users.noreply.github.com>
2024-07-16 22:30:35 +00:00
Vítor Vasconcellos
8a9d690aab Fix autoformat CI & format codebase (#2581)
* Update pnpm version

* Fix autoformat

* Improve autoformat msg

* Attempt to fix autoformat 2

* Fix autoformat

* Ignore deleted files in auto-format

* Fix diff filter

* Autoformat whole codebase

* Improve error message for autoformat CI

* Test autoformat CI

* Revert "Test autoformat CI"

This reverts commit 0bf2f46d1aa19bec92d73d4d62c8156473455040.
2024-07-04 08:57:43 +00:00
Ericson "Fogo" Soares
4eadb0de25 [ENG-1809] Make core more resilient to crashes (#2574)
* Catching panics

* Re-enable unwind on release profile

* Reverting deps due to bad assertion

* Comment why the deps where reverted

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
2024-06-30 03:59:01 +00:00