Kopia v0.7.1 release notes

We are excited to announce the release of Kopia v0.7.1. This release adds major usability, performance and supportability improvements and fixes bugs.

This release also adds support for RPM and APT repositories for Linux as well as Scoop package for Windows.

To discuss this release and provide feedback, please go to Kopia Forum Documentation is available at https://kopia.io/docs/

CLI Changes

Restore support for symlinks (experimental) (#621)
Ensure advanced commands are not accidentally used (#611)
Fixed snapshot delete to support deleting file (not directory) snapshots by object ID (#613)
Remove maintenance lock file on disconnect (#616)
Fixed checkpointing to not restart the entire upload process (#594)
Plumbed through missing —server-cert-fingerprint option (#580)
Tools to help investigate repository structures safely (read-only mode and index inspect) (#553)
cli: ignore trailing / in repository server URL (#569)
Improvements to UX for mounting directories (#573)
Changed default file log level to debug
implemented Cache Directory Tagging Specification (#565)
added support for setting and changing repository client options (description, read-only, hostname, username) (#589)
don’t ask for password if repository is not connected (#627)
fuse: changed file read implementation to avoid OOM (#620)

Kopia UI Changes

Kopia UI improvements for creating repositories and connecting to repositories (#592)
Added ability to connect to kopia server and few other minor tweaks (#546)
Improvements to UX for mounting directories (#573)
Added license ID and description
Fix for zero-sized snapshot bug (#641)

Repository Improvements

Re-enables deletion of unused data blobs which was disabled in v0.6.3
content: allow objects marked for deletion to be read (addresses unavoidable race condition) (#601)
object: implemented fast concatenation of objects by merging their index entries (#607)
splitter throughput improvements (#606)
bugfix: fixed splitter reset on reuse (#596)
bugfix: fixed index compaction that would resurrect content entry during full maintenance (#563)
bugfix: upload: fixed ForceHashPercentage behavior to be non-deterministic (#579)
upload: scan the directory to be uploaded in parallel to estimate the amount of data to be uploaded (#622)
Set BuildVersion during repo initialization. (#572)
Added support for Blake3 hashing (#640)

Server Improvements:

pre-read request body to fix HTTP/2 deadlock (#539)

Infrastructure Improvements

added RPM and APT repositories (#600)
build: publishing of scoop Windows packages via goreleaser
added endurance test which tests kopia over long time scale (#558)
upraded to Go 1.15 (#598)
logging: revamped logs from content manager to be machine parseable (#617)
testing: added performance benchmark (#618)

Providers

Experimental rclone backend (#545)
SFTP connectivity and docs improvements (#623)

Compatibility Information

v0.7 release is compatible with repositories created with v0.6 and v0.5.
Due to splitter bug in previous releases (#595) repositories created using previous releases may not provide perfect deduplication for large files across multiple machines. Migrating the repository to v0.7 is recommended and will help reclaim the disk space.

Changelog

b71e551f app: changed releaseType to release to fix publishing artifacts to GitHub, 2nd try a5f275b2 app: changed releaseType to release to fix publishing artifacts to GitHub 8febe90e goreleaser: switch draft mode to off as it interferers with scoop publishing 44968af7 release: fixed RPM signing by moving all of this to a single invocation of sign.sh 67ed3a9f Remove maintenance lock file on disconnect (#616) 9faf6b33 cli: fixed snapshot delete to support deleting file (not directory) snapshots by object ID (#613) f0b97b96 Fixed checkpointing to not restart the entire upload process (#594) 6a14ac8a cli: ensure advanced commands are not accidentally used (#611) 5784d687 site: edited installation page and switched Download link to point at it (#603) 64b60181 Test for directory reuse after GC (#601) e22d22db object: implemented fast concatenation of objects by merging their index entries (#607) faf28061 Splitter throughput improvements (#606) aebf8616 object: loadSeekTable helper (#608) 57888a81 travis: disable publishing RPM on pull requests since it needs credentials e4077674 build: publishing of scoop Windows packages via goreleaser f3fc2ea3 tools: misc fixes to RPM publishing 5494746e tools: clean up repomd directory before updating 17764567 travis: update RPM and APT repos on linux/amd64 even for non-tagged commits acc98d89 Trivial test nits (#602) 70df5f73 testing: Refactor faketime (#597) f8d0abb0 Makefile: fixed publishing logic 4ef314be Added RPM repository (#600) 9d0b8081 Go 1.15 (#598) 913b3bbd object: fixed splitter reset on reuse (#596) 640eb5dd Update BUILD.md 3b879024 Kopia UI improvements for repository management (#592) 29ce1819 Added support for setting and changing repository client options (description, read-only, hostname, username) (#589) a5838ff3 Improvements to UX for mounting directories (both CLI and KopiaUI) (#573) 90a9cf11 cli: plumbed through missing —server-cert-fingerprint option (#580) a3be1e5c upload: fixed ForceHashPercentage behavior to be non-deterministic (#579) 5e2994b4 content: fixed index compaction that would resurrect content entry during full maintenance (#563) ded1ecf9 implemented Cache Directory Tagging Specification + CLI + UI (#565) c242235a blob: added SetTime() method which may be optionally implemented by blob.Storage (#575) 3d24fd88 apt-publish: publish dummy i386 release, even though we don’t make packages for it as Ubuntu on amd64 is sometimes confused and tries downloading i386 anyway (#574) 39f1fae8 Set BuildVersion during repo initialization. (#572) 965160db cli: ignore trailing / in repository server URL (#569) 0dbaae1f ui: fixed typo (#570) bce4d78a site: fixed edit link (#568) 62c1a775 Doc: fix create B2 repository cmd (#566) 20117968 website: added link to kopia forum (#561) 1a8fcb08 Added endurance test which tests kopia over long time scale (#558) c11850cf Tools to help investigate repository structures safely (#553) f41e904a logging: changed default file log level to debug e7675f2d Address additional suggestions from fio workload PR #529 (#550) 5769b753 Minor doc edits (#549) 7ae82394 Experimental rclone backend (#545) 48f25317 kopia-ui: added ability to connect to kopia server and few other minor tweaks (#546) 27ec5c70 server: pre-read request body to fix HTTP/2 deadlock (#539) 923c91b5 infra: set up github action to run quick lint on pull requests (#535) da6b9335 [Robustness] Add additional fio workloads and fix fio runner (#529) f0751233 apt: update caching parameters after push f5417343 site: updated installation instructions now that we have APT repository (#534) 14d50aaa [Robustness] Fix for kopia runner and custom working directory (#533) b4f28fb1 kopia-ui: added license ID and description 3f71aef1 apt: fixed matching unstable version numbers b7872760 makefile: fixed BOTO_PATH b381d31e tools: added apt-publish tool that push to APT repository 6915e032 goreleaser: tweaks to support APT repositories 0c3ab133 [Robustness] Fswalker should ignore host name (#531) 7da4022c [refactor] Move robustness and engine packages (#528) 9a6dea89 Linter upgrade to v1.30.0 (#526) 98a2bc6 testing: increase sleep time to fix flaky arm64 test 7f61dc6 [Robustness] Add command line parameters for kopia snapshotter (#576) c7be3a0 testing: added performance benchmark (#618) c9c8d27c Repro and fix for zero-sized snapshot bug (#641) 892af670 Add support for Blake3 hashing (#640) 0f449f31 Update dependencies (#639) ae6a9600 Prefer t.TempDir() over makeScratchDir(t) (#612) 6b0b79af Trivial: update git attributes for Makefile (#638) 44ad8b58 Update build-armhf.yml 6bdcb817 ignorefs: fixed arm-specific linter warning (#637) b8c506b9 Create build-armhf.yml 090cd1cc Minor edits for SFTP documentation (#635)