1bb12a5035
allow pending updates to clear in acceptance tests
2019-12-11 14:43:59 +00:00
ad19fee667
add setting so that double flush is the default
...
can be disabled to stop flushing to track-changes
2019-11-25 13:36:25 +00:00
4f6583bbf2
fix getDocVersion and add tests
2019-11-25 13:28:36 +00:00
8b73bb9f13
Merge branch 'master' into bg-filter-track-changes-updates
2019-11-22 10:41:33 +00:00
b7055eecee
add metrics for history flushes
2019-11-22 09:14:32 +00:00
dcd7649bad
filter track-changes updates for projects using project-history
2019-11-19 10:02:56 +00:00
08ee58abb8
remove console.log from tests
2019-11-15 09:34:13 +00:00
82a72c9b73
fix missing bodyParser limit
2019-11-14 16:32:59 +00:00
d82b180b76
avoid project history queues building up with deferred flush
2019-10-03 04:05:24 +01:00
2845b23b70
add smoothing of delete spikes
2019-10-01 15:01:53 +01:00
0f0682df43
allow flush to complete in acceptance test
2019-09-26 16:00:11 +01:00
9f358ead9f
add an acceptance test for flush with queue processing
2019-09-26 10:55:05 +01:00
f6b2ac7360
queue deletes for deferred processing
2019-09-25 16:42:49 +01:00
912a3a7753
remove redis server-side hashing for performance
...
we still compute the document hash in node, and check it on retrieval
but we don't check the hash at the point of writing it in redis which
was previously done with a redis Lua script.
2019-09-09 15:27:58 +01:00
e75f2cc325
add unit tests for skipping history flush
2019-08-15 11:01:45 +01:00
7493462154
add acceptance test for realtime shutdown
2019-08-15 10:38:07 +01:00
97487a077e
fix cluster/sentinel connection with real-time
2019-07-10 09:42:05 +01:00
3b3b2da0f5
add pubsub redis connection and remove real time redis connection
2019-07-04 13:34:31 +01:00
e8a8c446ed
Increase timeout on test?
2019-06-19 11:34:38 +01:00
080b482e51
Update logger, metrics, and redis
...
Also fix acceptance tests, broken by a change in the redis driver
behaviour. It now returns promises from most operations, which confuses mocha.
2019-06-19 10:25:54 +01:00
984b2d38e6
add unit tests
2019-06-11 16:33:14 +01:00
e95059f98e
handle non-urgent flushes in background
2019-06-03 10:01:10 +01:00
0bbfa7de27
Merge branch 'master' into bg-downgrade-delete-component-error
2019-05-08 09:07:02 +01:00
27a8248196
convert "Delete component" errors into warnings
2019-05-07 16:55:17 +01:00
e57741cb80
stub out project flusher for unit tests
2019-05-07 15:46:30 +01:00
c1c23e4bee
record last author id on document flush
...
This is a multi-steps process:
* get a update's `user_id` from the metadata
* store the `user_id` (`lastUpdatedBy`) and current date (`lastUpdatedAt`) for
the document in Redis on every updates
* fetch `lastUpdatedAt` and `lastUpdatedBy` from Redis on document flush
* send the data to web to be persisted in Mongo
2019-05-02 11:10:02 +01:00
52f3596e53
Review feedback
2019-04-16 11:05:17 +01:00
3d76f4b9bf
Record a snapshot to mongo when a doc's comments/changes get collapsed
2019-04-11 13:27:46 +01:00
fd1425d83f
include a unique id in every message published to redis
2019-03-21 12:10:15 +00:00
8c5d74faef
use explicit json content-type to avoid security issues with text/html
2019-02-12 16:45:11 +00:00
ecaef6485b
revert the removal of realtime keyspace
2019-02-07 15:27:51 +00:00
4e1a2c787c
Revert "turn down logging, use logger.info for less important data"
...
This reverts commit c5f91428e3c7702fbbd3ffd1ef7a772d513f33f2.
2019-02-06 15:29:22 +00:00
1217d8a80a
Merge branch 'master' into csh-ho-docker-issue-1338-bulk-upgrade
2019-01-04 09:18:40 +00:00
2505be283a
turn down logging, use logger.info for less important data
2018-12-13 12:46:10 +00:00
25e1ad7491
remove redis.realtime
...
real time pushes data into the document updater redis instance
2018-12-05 16:17:41 +00:00
aae1352519
ensure that project history is flushed when the project is deleted
2018-10-30 12:03:44 +00:00
fdcb806518
set a timestamp for the first entry in the projectHistory:Ops queue
2018-07-24 09:17:31 +01:00
e471730efb
Revert "Merge pull request #33 from sharelatex/bg-add-timestamp-marker-to-project-history-queue"
...
This reverts commit 8ec398b133aa75c45384dd7ceb630cd743f4a15c, reversing
changes made to e3a6c934cf53fd245d7d0df737463cc90f954885.
2018-07-23 16:05:04 +01:00
6237577f87
set a timestamp for the first entry in the projectHistory:Ops queue
2018-07-20 10:43:31 +01:00
62a10f25f2
move tk call to before sandboxed module call
2018-06-05 13:54:30 +01:00
af92ca70a1
coerce projectHistoryId to integer after reading from Redis
2018-04-23 15:19:06 +01:00
1b63141e49
Revert "Revert "Add projectHistoryId to updates""
2018-04-23 12:08:04 +01:00
3cc20d6311
Revert "Add projectHistoryId to updates"
2018-04-23 11:41:29 +01:00
25c0be4eaa
add projectHistryId to project structure updates
2018-04-13 15:22:05 +01:00
a220794d32
add projectHistoryId to resync updates
2018-04-13 15:22:05 +01:00
fb1852a593
cache projectHistoryId with doc in Redis
2018-04-13 15:22:05 +01:00
779f00f912
add acceptance test for ordering of project structure changes
2018-03-15 16:27:14 +00:00
3385d2640a
fix structure ordering bug
2018-03-15 16:27:10 +00:00
75a5428cbf
update acceptance tests
2018-03-15 16:24:14 +00:00
b3887fd984
update unit tests for incoming project versions
2018-03-15 16:24:11 +00:00
Brian Gough