Our GitHub app manages all non-UTF decodable files and files over the size of 256KB within a GitHub repository, storing any files of those types on XetHub servers and using a pointer to track the file in GitHub. On changes to managed files, the XetData app adds comments on commits and pull requests that link to full file views on XetHub.
How is the XetData integration different from Git LFS or DVC?
Git LFS and DVC also add large file support via pointers, but require extra commands to track files in Git repositories. Developer experience matters! Our Git-Xet extension builds on top of Git, and uses the same commands for pushing, pulling, etc. so you never need to remember an extra line.
In a head-to-head comparison, Git-Xet is faster than Git LFS and DVC and scales to support much larger repositories. Read more on our performance benchmark blog.
How is the XetData integration different from XetHub?
The XetData GitHub app makes it easy for GitHub users to push large files to their repositories and get links to full file views on pull requests and commits. The benefit of this is that you can try out Xet large file support and rendering from within GitHub. However, apps on GitHub have limited interfaces, so Xet managed files show up by default in the GitHub UI as pointer files. Using XetHub shows files directly in our interface without extra links to outside views. See all limitations in our docs.
Yep! Just add the app to your account and specify the repositories you want to use with it. If you find that you don't like it, it's a few easy steps to undo the installation and bring back your repository as it was beforehand, with no hit to your Git history.
How much does this cost?
Storage through the XetData GitHub app is currently free! There's no excuse not to give it a try and let us know how it goes.
Works with your existing data tools
Keep your existing file formats, libraries, ML frameworks, and IDEs.