Apostol Apostolov

Practical thoughts about software

Fixing large amounts of RavenDB conflicts

Some time ago I had a small issue with RavenDB master-master replication which ended up in creating 50 000 conflicted documents on a live databaseSmile  It all ended fine but I had a little hard time of finding info on how to fix that kind of issue ‘fast’. Don’t get me wrong – there is a very nice RavenDB documentation about replication and conflicts but I didn’t find a fast-and-easy solution(one that involved couple of clicks in Raven’s studio) and I was a little disappointed about that. Guess RavenDB makes you little spoiled.

Anyway, here’s my solution:

1. First, you create an RavenDB index(you can create it through the studio):

Let’s name it ConflictsIndex. This index extracts all the documents of a database in an index so you could query them.

2. Then you Execute it to see the results.

execute

Don’t worry if there are no results at first. If you have large amount of data and large amount of conflicted documents – RavenDB would need some time to index them all. During that time you could:

3. Create an Console app that fixes the conflicts of the documents.

This console app will load all the documents from the currently created index in batches of 1000(usually RavenDB has a default limit 1024 items per select so we use 1000). While loading the documents if there are any conflicts, they will be automatically fixed with the TakeNewestConflictResolutionListener. This listener chooses always the last document to be the resolved one. If you need different custom logic for resolving the conflicts – the listener is the place to insert your code.

4. Execute the console application on the database. You could wait for the ConflictsIndex to finish indexing and run the console app.  If the database is a remote one(most production databases are) – you could copy the console app on some PC that is in the LAN of the PC with the database so the process would be faster.

Also it’s good to put a default Conflict Resolution Listener in your application if you don’t have one. Just in case. If you don’t have one – every time you try to load a conflicted document  - an exception is thrown, so the situation could get pretty heated pretty fast.

And that’s it. Usually you shouldn't get to situations like that but when you do - it’s good to know how you can get out of them.

Tags:

Posted By: Apostol Apostolov

Published at

Originally posted at

Comments

No comments posted yet.