When we start writing to cloudelastic we want to make sure a) that we can monitor differences between its indices and those in other elasticsearch clusters, and b) that we can ramp up the SUP while still keeping the cirrus jobs operational.
Hence, we need two sets of clusters, one the saneitizer queues write operations for and another, for which differences are only logged.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T317045 [Epic] Re-architect the Search Update Pipeline | |||
| Resolved | EBernhardson | T354793 SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs |
Change 991599 had a related patch set uploaded (by Peter Fischer; author: Peter Fischer):
[mediawiki/extensions/CirrusSearch@master] Implement read-only checks
Change 991599 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Implement read-only checks
Change 993817 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[mediawiki/extensions/CirrusSearch@master] Run CheckerJob against read-only clusters
Change 993817 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Run CheckerJob against read-only clusters
Change 994142 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[mediawiki/extensions/CirrusSearch@wmf/1.42.0-wmf.15] Run CheckerJob against read-only clusters
Change 994143 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[mediawiki/extensions/CirrusSearch@wmf/1.42.0-wmf.16] Run CheckerJob against read-only clusters
Change 994328 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[mediawiki/extensions/CirrusSearch@master] Change CirrusSearchClusters merge strategy to provide_default
Change 994142 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@wmf/1.42.0-wmf.15] Run CheckerJob against read-only clusters
Mentioned in SAL (#wikimedia-operations) [2024-01-30T21:28:52Z] <cjming@deploy2002> Started scap: Backport for [[gerrit:994142|Run CheckerJob against read-only clusters (T354793)]]
Mentioned in SAL (#wikimedia-operations) [2024-01-30T21:30:22Z] <cjming@deploy2002> ebernhardson and cjming: Backport for [[gerrit:994142|Run CheckerJob against read-only clusters (T354793)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Change 994143 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@wmf/1.42.0-wmf.16] Run CheckerJob against read-only clusters
Mentioned in SAL (#wikimedia-operations) [2024-01-30T21:36:42Z] <cjming@deploy2002> Finished scap: Backport for [[gerrit:994142|Run CheckerJob against read-only clusters (T354793)]] (duration: 07m 49s)
Mentioned in SAL (#wikimedia-operations) [2024-01-30T21:37:10Z] <cjming@deploy2002> Started scap: Backport for [[gerrit:994143|Run CheckerJob against read-only clusters (T354793)]]
Mentioned in SAL (#wikimedia-operations) [2024-01-30T21:38:37Z] <cjming@deploy2002> cjming and ebernhardson: Backport for [[gerrit:994143|Run CheckerJob against read-only clusters (T354793)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-01-30T21:44:51Z] <cjming@deploy2002> Finished scap: Backport for [[gerrit:994143|Run CheckerJob against read-only clusters (T354793)]] (duration: 07m 41s)
Change 994328 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Change CirrusSearchClusters merge strategy to provide_default
Change 999974 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[mediawiki/extensions/CirrusSearch@master] Connection: Correct read-only detection
Change 1002434 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[mediawiki/extensions/CirrusSearch@wmf/1.42.0-wmf.17] Connection: Correct read-only detection
Change 1002434 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@wmf/1.42.0-wmf.17] Connection: Correct read-only detection
Mentioned in SAL (#wikimedia-operations) [2024-02-12T22:40:37Z] <ebernhardson@deploy2002> Started scap: Backport for [[gerrit:1002434|Connection: Correct read-only detection (T354793 T356526)]]
Mentioned in SAL (#wikimedia-operations) [2024-02-12T22:41:58Z] <ebernhardson@deploy2002> ebernhardson: Backport for [[gerrit:1002434|Connection: Correct read-only detection (T354793 T356526)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-02-12T22:49:12Z] <ebernhardson@deploy2002> Finished scap: Backport for [[gerrit:1002434|Connection: Correct read-only detection (T354793 T356526)]] (duration: 08m 35s)
Change 1003827 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[mediawiki/extensions/CirrusSearch@wmf/1.42.0-wmf.18] Connection: Correct read-only detection
Change 999974 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Connection: Correct read-only detection
Change 1003827 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@wmf/1.42.0-wmf.18] Connection: Correct read-only detection
Mentioned in SAL (#wikimedia-operations) [2024-02-15T23:52:25Z] <thcipriani@deploy2002> Started scap: Backport for [[gerrit:1003827|Connection: Correct read-only detection (T354793 T356526)]]
Mentioned in SAL (#wikimedia-operations) [2024-02-15T23:53:50Z] <thcipriani@deploy2002> ebernhardson and thcipriani: Backport for [[gerrit:1003827|Connection: Correct read-only detection (T354793 T356526)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-02-16T00:02:53Z] <thcipriani@deploy2002> Finished scap: Backport for [[gerrit:1003827|Connection: Correct read-only detection (T354793 T356526)]] (duration: 10m 28s)