Commit Graph
100 Commits
Author SHA1 Message Date
Tom Hacohen baa42d040d Collection: also save the collection UID on the model itself.
This enables us to have db-constraints for making sure that UIDs are
unique, as well as being more efficient for lookups (which are very
common).

The UID should always be the same as the main_item.uid, though that's
easily enforced as neither of them is allowed to change.
2020-12-14 13:33:11 +02:00
Tom Hacohen 057b908565 Update changelog. 2020-12-04 19:17:43 +02:00
Tom Hacohen 2d0bcbdc20 Stoken annotation: move it all to one place to reduce duplication. 2020-12-04 19:03:13 +02:00
Tom Hacohen 4ce96e043e Collection: further improve stoken performance.
We merged the two queries into one and we made it like in the view, so we
can now merge the two instead of having two implementations.
2020-12-04 18:55:22 +02:00
Tom Hacohen bb070639a3 Collection: fix the slow performance when calculating stoken.
We were running a very expensive query instead of the much simpler and
more efficient alternative we just introduced.
2020-12-04 18:28:58 +02:00
Tom Hacohen c790b5f489 Reformat some files using black. 2020-12-01 12:45:38 +02:00
Tom Hacohen d893d35c6f Fix the host checks to only check against hostname.
Fixes https://github.com/etesync/etesync-web/issues/183
As discussed in #66
Continuation of 843b59a0ac.
2020-11-20 18:11:35 +02:00
Tom Hacohen 1c8f7cdc60 Update changelog. 2020-11-19 10:13:13 +02:00
Tom Hacohen 13a46cb1db Myauth: add missing migration.
Fixes #70
2020-11-19 10:13:13 +02:00
Tom Hacohen 9ec16e9216 Update changelog. 2020-11-14 16:56:26 +02:00
Tom Hacohen ab8b2bc58a README: update + add chat badge. 2020-11-12 14:07:41 +02:00
Tom Hacohen bdd787b915 Gracefully handle uploading the same item twice.
We were failing until now, but since the uid is sure to be unique,
we can just assume that if it's the same uid it's the same content.
This means we can just gracefully fail as the data is the same.

Until now, we were raising an error, but we now just do nothing
and consider it a success.

This is especially useful when a network error caused an item to
be uploaded but not updated on the client side.
2020-11-10 10:07:56 +02:00
Tom Hacohen 47103df48a Change user creation to not ask for a password (and clarify the readme). 2020-11-07 18:58:29 +02:00
Tom Hacohen 801826b8b6 Fix the URL in the success template. 2020-11-05 16:50:09 +02:00
Tom Hacohen 65319047b8 Remove leftover files from EteSync 1.0.
No idea how they got here.
2020-11-05 16:49:10 +02:00
Tom Hacohen 843b59a0ac Login/Changepassword: change to verifying the hostname without the part.
Verifying the port was causing issues, and anyhow, this check is
paranoid and isn't strictly necessary for security.
The problem is that Django's `get_host()` and the equivalent on some
platforms returns it without the port, though on others (like e.g. the
library we use from JS) it returns with the port. This was inconsistent
and was causing authentication to fail.

We thus relaxed the test to not include the port when matching, which
should make it work consistently across all platforms.
2020-11-02 10:16:06 +02:00
Tom Hacohen a6f5e070a4 Update changelog. 2020-11-01 11:32:22 +02:00
Tom Hacohen 422b62d5b2 Disallow creating new collections without a collection type set. 2020-11-01 11:29:01 +02:00
Tom Hacohen f55ebeae7c Collection saving: add another verification for collection UID uniqueness.
Even with the previous check, there could still be a race condition where two
collections with the same UID are created. Adding this extra check after
will prevent that from happening.
2020-11-01 11:29:01 +02:00
Tom Hacohen 46abeac2c0 Test reset: also reset memberships. 2020-10-25 12:15:13 +02:00
Tom Hacohen 3b4cd424ab Update changelog. 2020-10-18 18:29:00 +03:00
Tom Hacohen 0e814ea410 Merge: merge in the new etebase (EteSync 2.0) code 2020-10-18 17:50:52 +03:00
Tom Hacohen 5bce4d9932 Collection Type: fix backwards compatibility for creating new collections.
Continuation to 409248d419.
2020-10-15 15:06:24 +03:00
Tom Hacohen 409248d419 CollectionTypes: add backward compatibility adjustments until 2.0 is out. 2020-10-15 10:50:07 +03:00
Tom Hacohen 5d8a92f000 Collections: add support for collection types.
We also added the field for invitations, as it's needed for collections
to work.
2020-10-13 18:39:18 +03:00
Tom Hacohen acd22b9b47 Serializers: remove unused field. 2020-10-13 16:30:16 +03:00
Tom Hacohen 741b6d7c52 Collection removed memberships: only return removed memberships within our returned range.
Before this change we were returning all of the removed memberships that happened
after stoken. Though instead, we should just return the removed memberships that
happened after stoken and before the new stoken we are returning.
2020-10-13 13:50:06 +03:00
Tom Hacohen aa7b049b62 Stoken: always return the stoken object, not the rev. 2020-10-13 13:49:29 +03:00
Tom Hacohen c7bd01b2d1 Logout: allow any authenticated user (instead of normal permissions).
We should always allow users to log out if they are authenticated. This
doesn't need to use the global permissions.
2020-10-13 12:09:34 +03:00
Tom Hacohen 47f3e08846 Signup: improve docs. 2020-10-13 11:10:55 +03:00
Tom Hacohen 24c161b0d8 Signup: don't try to clean fields for objects we haven't created. 2020-10-13 11:09:22 +03:00
Tom Hacohen 9cad5d62e1 Account: change Dashboard URL endpoint's permissions.
We only want to require that the account is authenticated, not the rest of
the permissions. As we want to be able to get a dashboard url for accounts
that aren't currently valid.
2020-10-09 13:10:41 +03:00
Tom Hacohen 74f40abc65 Account: add a dashboard url endpoint.
This lets servers share a dashboard url with clients so that they in
turn can present clients with a settings dashboard.
We currently use it on the main server, but self-hosted servers may
also benefit from it for letting users manage some of their settings
(e.g. 2FA).
2020-10-08 21:06:33 +03:00
Tom Hacohen 9152e6f42d Fix bad stoken error.
We were calling the validation constructor wrong.
2020-10-08 21:01:45 +03:00
Tom Hacohen 06f2dd72a7 Exception: fix detail/code for exception. 2020-10-01 16:50:09 +03:00
Tom Hacohen 6214688170 Invitations: share the username of the inviter. 2020-10-01 16:47:53 +03:00
Tom Hacohen 1e7e9eceac README: update signup instructions to EteSync 2.0.
Fixes #55.
2020-09-27 09:45:31 +03:00
Tom Hacohen 8a557ff82c Disable signups by default.
The next commit includes README instructions on how to create users
and enable signups.
2020-09-27 09:42:01 +03:00
Tom Hacohen f5ced873ac Lint: fix lint errors. 2020-09-23 16:27:20 +03:00
Tom Hacohen 5c803d8a51 Only expose drf's auth in debug mode. 2020-09-22 18:00:28 +03:00
Tom Hacohen 5d9b47531b Collectin: make sure collections always have a unique UID. 2020-09-22 12:17:33 +03:00
Tom Hacohen 18b3f45b79 Collection main_item: make a OneToOneField intsead of just a foreign key. 2020-09-22 11:33:17 +03:00
Tom Hacohen 7b8b0a5685 Login: make case insensitive. 2020-09-21 12:09:19 +03:00
Tom Hacohen 4dbdb3d7cf Invitations: gracefully error when trying to invite an already invited user. 2020-09-20 19:33:55 +03:00
Tom Hacohen 374048f013 Fix disabling of browseable API when debug is off. 2020-09-13 14:37:48 +03:00
Tom Hacohen 00cf2d83a0 Only enable browsable API when debugging is on.
The reason for that is that the API may expose data that shouldn't be exposed,
such as the list of users on the service.
2020-09-13 14:17:57 +03:00
Tom Hacohen 3de1d48b9e Browsable API: use input fields for relations. 2020-09-13 14:17:57 +03:00
Tom Hacohen c04650f890 README: update contribution information. 2020-09-11 16:02:47 +03:00
Tom Hacohen eac8fae376 README: update contribution information. 2020-09-11 16:01:44 +03:00
Tom Hacohen 9efb8d4c40 Update example-configs to etebase. 2020-09-10 19:21:22 +03:00
Tom Hacohen 38e0700ac0 Update django and remove unused deps. 2020-09-10 19:19:19 +03:00
Tom Hacohen 9c6a7e9428 Login: fix server error when trying to login to users without userinfo. 2020-09-10 13:31:54 +03:00
Tom Hacohen a85e816810 User not found: return a 401 instead of a 404. 2020-09-09 17:07:32 +03:00
Tom Hacohen d90931fbe5 Make access level an int instead of a string.
We started with a string because we thought it could maybe provide more
flexibility, though really, an int makes much more sense, especially on
all the platforms etebase runs nowadays.
2020-09-07 11:02:53 +03:00
Tom Hacohen 43569727f4 Signup: send a signal on account signup. 2020-09-02 12:54:50 +03:00
Tom Hacohen 42a72ce5c7 Serializers user signup: correctly handle EtebaseValidationErrors.
Don't coerce them to strings
2020-09-02 12:50:51 +03:00
Tom Hacohen 7ab9513e05 Serializers: rename message to detail to conform with the rest of the API.
This was a mistake in the previous commit.
2020-09-02 11:11:20 +03:00
Tom Hacohen bf22b1676f Serializers: improve field serialization errors. 2020-09-02 11:07:43 +03:00
Tom Hacohen 2327466113 Invitations: error when trying to invite oneself. 2020-08-28 13:55:15 +03:00
Tom Hacohen 8593ab1357 Login: add a user visible error on password failure. 2020-08-18 12:24:30 +03:00
Tom Hacohen 693a5ec778 Login: return an UNAUTHORIZED (401) error on bad username/password, not 400. 2020-08-18 12:04:42 +03:00
Tom Hacohen 5af2aeda7e Add an endpoint to know if a server is an etebase server or not.
Very useful for when migrating people from legacy EteSync apps because
we can automatically know if they are running a self-hosted etesync or
etebase server.
2020-08-18 12:03:00 +03:00
Tom Hacohen cf9b6f5904 Prefetch: change the type of value prefetch accept.
It's 'auto' by default, but can be changed to 'medium' and soon
another value.
2020-08-04 17:48:34 +03:00
Tom Hacohen a613a32628 prefetch: fix handling of the prefetch param. 2020-08-04 17:39:33 +03:00
Tom Hacohen e385aa8f20 Chunks: use a prefix of the chunk for a subdirectory.
Filesystems don't handle massive directories too well, so better to split.
Using the prefix of the chunk gives us a maximum of 64 * 64 = 4096 entries
in the main directory.
2020-08-04 17:39:33 +03:00
Tom Hacohen 393b85d3ca Chunks: move to reside under the collection. 2020-08-04 17:39:33 +03:00
Tom Hacohen 1d5baece1e Chunk uploading: implement properly using a custom Parser. 2020-08-04 14:15:25 +03:00
Tom Hacohen 11001ed62c Chunk serializer: fix bad error invocation. 2020-08-04 13:17:48 +03:00
Tom Hacohen f6af96ace6 Permissions: workaround DRF bug and expose exception code. 2020-07-30 10:17:33 +03:00
Tom Hacohen c0575cb64c Exceptions: have correct code/status_code for every error. 2020-07-30 10:13:24 +03:00
Tom Hacohen 04231ebfe5 Views: fix issue with iterators sometimes returning the wrong type. 2020-07-25 09:30:40 +03:00
Tom Hacohen 9c129e5731 Collection erializer: make the item a child instead of trying to merge them. 2020-07-22 11:31:08 +03:00
Tom Hacohen 3d6ba634ce Disallow + in usernames. 2020-07-16 10:40:30 +03:00
Tom Hacohen a7268443ca Add support for a modifying the chunk storage location 2020-07-13 17:08:36 +03:00
Tom Hacohen c9463cadba Add support for a custom user creation function. 2020-07-13 16:20:46 +03:00
Tom Hacohen e41f8455f2 app settings: rename the get user queryset func setting name. 2020-07-13 16:08:46 +03:00
Tom Hacohen 46b4f08afa Signup: use the get_user_queryset function when checking if user exists. 2020-07-13 16:03:34 +03:00
Tom Hacohen af86d877f2 Signup: use the shorthand version of setting an unusable password.
It wasn't actually saving the unusable password before.
2020-07-13 15:40:29 +03:00
Tom Hacohen a39617cf2e Make sure usernames are case insensitive on lookup 2020-07-13 15:39:08 +03:00
Tom Hacohen 5c2f4d96ad app settings: cache all the properties rather than recalc every time.
They never change during runtime anyway.
2020-07-13 15:39:08 +03:00
Tom Hacohen f9add36f18 Add support for custom user filtering. 2020-07-13 15:39:04 +03:00
Tom Hacohen 3680bd53b1 Views: change according to DRF best practices. 2020-07-13 14:26:49 +03:00
Tom Hacohen 9ea01d4d93 CollectionMemberSerializer: change the user field to be read only. 2020-07-13 11:15:42 +03:00
Tom Hacohen 41a03e9d3b Invitation: fix the checks making sure you can't invite yourself. 2020-07-12 13:23:45 +03:00
Tom Hacohen 9f1bfceda7 Increase token ttl to 30 days. 2020-07-12 11:27:47 +03:00
Tom Hacohen 7ec45434ba User: make username case insensitive (and save original styling).
We want 'User' and 'UsEr' to mean the same user. Apparently that's not the default in
django. This normalizes the user to ensure we enforce this.
2020-07-12 11:11:33 +03:00
Tom Hacohen 9a518b3907 Chunks: add error handling for chunks having content or not existing.
If the chunk already has a content and we try to upload it again, we
assume the previous content was correct and this one is the same
(chunks are immutable). We can't actually ensure they are the same due
to the encryption, though they should be.

If a chunk is being uploaded for the first time and doesn't have a
content, throw a validation error rather than throwing an ugly error.
2020-07-10 09:29:21 +03:00
Tom Hacohen fae15fe420 Views: clean up how we use serializers and remove integrity_errors catch-alls.
The integrity errors were a bad relic from the EteSync sources and needed
to be removed.
2020-07-10 09:27:34 +03:00
Tom Hacohen 86c5d711a6 Chunk upload: item.uid can never be None so use it directly. 2020-07-10 09:09:11 +03:00
Tom Hacohen e8e859fa6a Add README. 2020-07-08 17:58:29 +03:00
Tom Hacohen 2d4410ef36 Add license file. 2020-07-08 17:58:29 +03:00
Tom Hacohen ee23707fff Debug reset: put the whole request in a transaction. 2020-07-08 17:58:29 +03:00
Tom Hacohen cc163d27af Add settings and configuration to run the etebase app. 2020-07-08 17:58:28 +03:00
Tom Hacohen 08c4aa9d43 Add .gitignore. 2020-07-08 17:58:00 +03:00
Tom Hacohen 4aa3daaa97 Create a new django project. 2020-07-08 17:57:57 +03:00
Tom Hacohen f69c3a327c Revert "django_etebase: make migration generic and not depend on myauth."
This reverts commit 925dcac0fb99204e3373251e12f8496721879361.
2020-07-05 13:15:42 +03:00
Tom Hacohen f147f4ae58 Serializers: allow encryptionKey to be null. 2020-06-29 15:39:40 +03:00
Tom Hacohen 3dfceb63b1 Views: move the base64 encoding to the renderers.
Hard-coding the serialization encoding in the serializers is wrong.
This fix now enables us to change to easily change to msgpack as the
transport layer.
2020-06-29 15:39:40 +03:00
Tom Hacohen 2880673e27 drf_msgpack: add code to parse/serialise msgpack
It's not actually used by clients but it's there and can be used. It
works for receiving msgpack messages, but doesn't yet work for sending
because some of the types will be converted to base64.
2020-06-29 14:21:43 +03:00
Tom Hacohen fbf5552a62 Modify binary64 field to support binary renderers/parsers
Fixes 39c1dfc53c30e65bcbff9e0ba0bb07bfc8bfc577
2020-06-29 13:36:37 +03:00