I suggest Solr ...

make atomic updates really atomic

Currently what's presented as atomic updates are really 'bulk' updates in that:

1. They require all fields to be stored, except copyFields.
2. They are essentially reindexing the entire document, not just the field under update.

These two restrict the adoption of the feature requiring changes to solr schema.

The good part of the feature though is the ability to save on network traffic by sending only the fields that need an update.

IMHO, this feature needs to be implemented on Lucene level, not Solr.

11 votes
Vote
Sign in
Check!
(thinking…)
Reset
or sign in with
  • facebook
  • google
    Password icon
    I agree to the terms of service
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    Dmitry KanDmitry Kan shared this idea  ·   ·  Admin →

    4 comments

    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      Submitting...
      • Dmitry KanDmitry Kan commented  · 

        Mikhail,

        do you think ExternalFileField will scale to hundreds of millions of values per index?
        We were considering it at one point, but found signals from other people reporting it to be not too efficient for large external files / frequent updates.

      • Mikhail KhludnevMikhail Khludnev commented  · 

        and also https://issues.apache.org/jira/browse/LUCENE-3837
        but one of committers said - It never happens, because it's never possible, or it's possible sometimes, until merge happens.

        as an intermediate step/workaround I have an idea of improving ExternalFileField just a one step forward of ElastiSearch's terms filter lookup.

      • Dmitry KanDmitry Kan commented  · 

        Interesting feature story: ~3 years in discussion and dev starts less than a year ago! Lets hope it makes it in soon. This suggestion is an echo from the comminity in support of the dev.

      Feedback and Knowledge Base