Compare commits

...

521 Commits
master ... v7.3

Author SHA1 Message Date
William L Qian
78d326bcab SERVER-93551: Rebalance file/task count for update fuzzers (#26152) (#26517)
The fuzzer currently tests 400 files in 20 tasks. This can timeout when
testing with 7.0 during multiversion tasks. This PR changes it to 400
files in 40 tasks, so that each task has half as many files and should
no longer time out.

Anything in this description will be included in the commit message.
Replace or delete this text before merging. Add links to testing in the
comments of the PR.

GitOrigin-RevId: eecc1ece8520103f7c99dd4466992745b2054632
2024-08-29 20:08:23 +00:00
John Daniels
ca8d6e587f SERVER-92780: Move sys-perf variants and tasks to DSI (#26034)
GitOrigin-RevId: f9f6e00b45c45b085d9555dca181871cbb32239f
2024-08-21 18:13:32 +00:00
SimonEismann
5edbed7e60 SERVER-93212 Include mongod version and git version information in the supplementary data (#25788) (#25796)
This PR includes an atlas_info.json file that contains the information
required for the atlas tests.

Anything in this description will be included in the commit message.
Replace or delete this text before merging. Add links to testing in the
comments of the PR.

GitOrigin-RevId: 4b5d3e320b05ec2820e778503f054e59a8f49cc8
2024-08-21 18:13:15 +00:00
Zack Winter
81c102cee4 SERVER-92939 Route tools download to the newest rhel version (#25595) (#25769)
(cherry picked from commit c3f828ae4afafd7d03661beb3f44e41958cb3320)

The tools binaries only are published for one minor version per major
version of RHEL. When the db tools team added rhel88 and rhel93 versions
of the binaries, they stopped publishing rhel80 (amd64), rhel82 (arm64),
and rhel90 versions.

Route the package tester to instead pull down the latest rhel version
that matches the major rhel version of the package (ex. rhel80 package
-> rhel88 tools)

This will be compatible because the tools binaries do not depend on any
system libraries that are not guaranteed to be compatible across minor
versions (per
https://access.redhat.com/articles/rhel8-abi-compatibility#Guidelines):

```
linux-vdso.so.1 [compat 1 via krb]
libresolv.so.2 [compat 1 via libc]
libpthread.so.0 [compat 1 via libc]
libgssapi_krb5.so.2  [compat 1 via krb]
libkrb5.so.3 [compat 1]
libc.so.6 [compat 1]
/lib/ld-linux-aarch64.so.1 [compat 1 via krb]
libk5crypto.so.3 [compat 1 via krb]
libcom_err.so.2 [compat 1 via krb]
libkrb5support.so.0 [compat 1 via krb]
libkeyutils.so.1 [compat 1 via krb]
```

GitOrigin-RevId: 841501a467c85eb853c7540695bec55fdbd25380
2024-08-05 22:03:51 +00:00
Sulabh Mahajan
86fc156ab1 SERVER-90893 Make list databases consistent to a given storage snapshot (#25100) (#25699)
This change makes list databases use a storage snapshot, and read lock
free instead of taking a global lock. The catalog helper that lists the
database will first look at the committed list, then at the pending
list. If the storage snapshot considers the pending list as committed,
the database will be considered into the list, if not already there.

(cherry picked from commit d47334fa8878d15d2237026651be8e5d5c426672)
(cherry picked from commit dc47a1f3e028ff456ce81376e102e581b8b075cf)

Anything in this description will be included in the commit message.
Replace or delete this text before merging. Add links to testing in the
comments of the PR.

GitOrigin-RevId: 5c4f21a0d22587febe8ae52128cdcf1e560a13d9
2024-08-05 19:08:07 +00:00
vstojkovic-mongodb
576444091c SERVER-93005 Avoid duplicating read preference when running an exhaust query in the shell (#25515) (#25591)
(cherry picked from commit 23416ef40b56fc169636560b96d4f94ec94e531a)

GitOrigin-RevId: 5a09f026ecb13d0fa0e3f15ac7114ac306749277
2024-08-05 16:57:06 +00:00
SimonEismann
df06e4be83 SERVER-92601 Remove the package_new_compile task from the critical path (#25566)
This PR backports the supplementary data changes to 7.3. This is a
test-only change.

GitOrigin-RevId: da2c2affe2a3482646ecac637630037306ecb2fb
2024-08-05 16:56:49 +00:00
Justin Seyster
85f76ddaf0 SERVER-92201 Make currentop_shell.js as robust as a strong cup of coffee in the morning (#25510)
GitOrigin-RevId: 87d7c8e0d0749727c38c3b7348da188f8b1a44df
2024-08-05 16:55:07 +00:00
Erin Liang
e71b45db45 SERVER-93099 Allow collMod with timeseriesBucketsMayHaveMixedSchemaData=false (#25715)
(cherry picked from commit 35432a8483d1a9fa6418a89d6652331e9de795b7)

GitOrigin-RevId: 42bf37e97a539e3e19d7e17d7753223e6c9a8cbf
2024-08-05 16:54:49 +00:00
henrikedin
4ee27b4454 SERVER-93014 Committing index builds locally may not change mixed schema flag (#25601) (#25656)
(cherry picked from commit 8e2f47b16520da57408308d9fad1d0e516085d6b)

GitOrigin-RevId: 49abd8c45b300ab4cfa07124b7fb145ea8a4fc5c
2024-08-02 13:29:20 +00:00
Juan Gu
9075a914bd SERVER-86879 concurrency_replication* tasks are not running on the UBSan DEBUG build variant (#25434)
(cherry picked from commit 4e425a7693ba065106e8667e57ca1f4275629c63)

GitOrigin-RevId: d858c5f1720190fa09bb582e01405178da9cc9b2
2024-08-01 19:10:49 +00:00
Juan Gu
258b5c635f SERVER-92733 update pygithub to 1.58 (#25225)
(cherry picked from commit 31e0706dfa24f3725e68f00040121b409f318429)

GitOrigin-RevId: 6d79c434a9621b0a307a9d46fcd150217b02f81b
2024-07-24 22:31:11 +00:00
Maria Prinus
172f0bca59 SERVER-92777 Replace "push_arch" with rhel80 and rhel82 to rhel8 to fix the URL (#25278)
GitOrigin-RevId: 3f58592925374a05c3801637304fd86a3928468c
2024-07-24 16:06:11 +00:00
Maria Prinus
eeb79936ed SERVER-92777 Replace "push_arch: x86_64-enterprise-rhel80" with "push_arch: x86_64-enterprise-rhel8" to fix the URL (#25239)
GitOrigin-RevId: 22c3b466ec924c72fda460ad92b329cc8030d20c
2024-07-23 23:11:09 +00:00
SimonEismann
08f636f29f SERVER-92379 Remove mongocrypt compile (#25103)
This PR removes the mongocrypt compile from sys-perf-7.3 as it is not
used here.

GitOrigin-RevId: 69b08ef4020cf667eea090f760966febdc16ca0c
2024-07-22 19:13:07 +00:00
Lynne Wang
d8837a25e0 SERVER-92623 Pin the version of v5.0 to 5.0.28 in timeseries_collection_mixed_type.js (#24973) (#25082)
5.0.28 still supports writing mixed schema buckets to timeseries
collection, so we can pin this version and retain test coverage for
upgrading versions in the presence of mixed schema buckets.

GitOrigin-RevId: 1aaafe7b559b7aaa6197834fc9b0ba54c8c499f0
2024-07-22 18:17:31 +00:00
Daniel Segel
a98354a428 SERVER-89748 Retry _flushRoutingTableCacheUpdates command if it fails in retry_on_transient_error_basic.js (#25105)
(cherry picked from commit b76157f178e105dc0d3b2013777f4b0d1055c14f)

EVG:
https://spruce.mongodb.com/version/669e792c05cd0400063f5218/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC
GitOrigin-RevId: e6fabd89493eb3137d2e8052e68b508402cad082
2024-07-22 17:59:58 +00:00
Zack Winter
36c9a424c2 SERVER-92689 Fix continuous multiversion tests on v7.3 branch (#25084)
Since the 7.2 branch is no longer being run, this previously was failing
to find a candidate for downloading binaries from the rhel8 variant.

GitOrigin-RevId: d701d051ec726348ac1c7135274570ce43171355
2024-07-22 12:32:55 +00:00
Israel Hsu
e51b493c04 SERVER-90727 Fixes analyze_shard_key.js test to ignore missing sampled docs (#24591)
[BACKPORT-21070](https://jira.mongodb.org/browse/BACKPORT-21070)

GitOrigin-RevId: 13e279019215d247ef70b0635741441a37424336
2024-07-22 12:32:38 +00:00
GrantXiao07
c47f7288f5 SERVER-82281 Deep-merges setParameter settings of ShardingTest fixture (#25057)
# Issue
SERVER-82281

# Description
Created parameter_override_during_merge.js to duplicate the overrding
issue discussed in the ticket. Added mergeDeepObjects function to
shardingtest.js. Changed Object.merge into mergeDeepObjects regarding
the otherParams variable. This allows for multiple SetParameters to
append upon each other instead of overriding.

GitOrigin-RevId: 51fcc823595c3769cd3f63017514b04de2738bb7
2024-07-19 20:57:03 +00:00
Sophia Tan
6f181627e7 SERVER-92401 replace distro rhel76-selinux with rhel79-selinux (#24710)
GitOrigin-RevId: 714b460bbbe8b6a863d72283d0a1c072ec283210
2024-07-19 19:27:56 +00:00
Peter Volk
1830eb5e8b SERVER-86905 replace $$NOW and $$CLUSTER_TIME before sending to shards (#24660)
[BACKPORT-20038](https://jira.mongodb.org/browse/BACKPORT-20038) from
the original ticket. There are a few additional artifacts that had to be
backported as well. Hence a non-trivial (but still simple) backport.

[Original
PR](47ca1ad473)

[Evergreen
patch](https://spruce.mongodb.com/version/6690ff4d7865cb00079a8997/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)

---------

Co-authored-by: henrinikku <henri.nikku@mongodb.com>
GitOrigin-RevId: 05f103196f431f4d115b772060453d8bc456c6f1
2024-07-19 19:27:38 +00:00
Israel Hsu
95e169f977 SERVER-89055 Fixes unique namespace generation for query sampling tests (#24593)
GitOrigin-RevId: d1ed6d2dea8707b21c5c77f382284b1ba72a150b
2024-07-19 19:27:20 +00:00
Zack Winter
5537bbcf5d SERVER-92670 Fix indents in test yml on 7.3 (#25052)
GitOrigin-RevId: 69130e4a8d6591c3f52eba141978cf882cb0bfd6
2024-07-19 19:27:02 +00:00
Zack Winter
f090154b0f SERVER-92375 Remove minor version from rhel8.x variant names (#25001)
https://jira.mongodb.org/browse/BF-34055 is caused by the rhel80 variant
names changing when we upgraded to rhel88. Update the variant names to
exclude the minor version to allow us to both upgrade more painlessly in
the future and fix the existing broken multiversion tests.

(v7.3 backport)

GitOrigin-RevId: 94fb5ca0f438d81b6391f52e9130128e313c9982
2024-07-19 19:26:44 +00:00
Lynne Wang
9f19cbc2d8 SERVER-92298 Remove unused ProjectionPathASTNode argument to speed up $project aggregation requests (#24635)
The queryStats [backport](https://jira.mongodb.org/browse/SERVER-87736)
introduced a projection field that held a `ProjectionPathASTNode` to
serialize projection ASTs. However, this field contributes to a 200-300%
regression in parsing aggregation expressions containing `$project` on
large constant arrays. Since the field is no longer used anywhere on
master, we can safely remove it to regain performance.

GitOrigin-RevId: 61aa721ebc259f84ba8db416cb5bcf619ba1974b
2024-07-19 13:33:43 +00:00
Jason Chan
3480f4ca50 SERVER-92158 Disable hedged_reads.js on windows variants (#24374)
(cherry picked from commit 690d7c2499f1bdd9ae7e0c9bb66a9522050810e6)

GitOrigin-RevId: edd5035178135c15522db13548eb07f48273ce35
2024-07-19 13:33:26 +00:00
Zixuan
f6e295e296 SERVER-92549 fix sbe_multiplanner_index_check.js (#24895)
https://spruce.mongodb.com/version/6698003ba5c0d000071d89a8/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC

GitOrigin-RevId: f861ceaed5bea45c6fdd39d5d5ee17bf63f0ec42
2024-07-18 21:27:48 +00:00
Will Buerger
4ccf5f56d7 SERVER-92193: Negated $geoWithin/$geoIntersects queries should not attempt to use a non-geospatial index (#24946)
GitOrigin-RevId: b6806567f4ab6ea2e6a7fb710f8c85bbf5646cae
2024-07-18 20:18:24 +00:00
HanaPearlman
e52dea532b SERVER-92603: Avoid rewriting parameterized expressions in or-to-in rewrite (#24972)
GitOrigin-RevId: 850ea7dac0e343cd1d5f8c59490e993696911b5f
2024-07-18 20:01:04 +00:00
Janna Golden
946712e49c SERVER-85327 Use countDocuments() instead of itcount() when asserting document count in write without shard key concurrency workloads (#18449) (#24981)
Co-authored-by: Jason Zhang <jz1242@users.noreply.github.com>
GitOrigin-RevId: 2600b2d37df924098539f0b63b95b32b88b6ec05
2024-07-18 19:39:12 +00:00
Erwin Pe
13adb422bc SERVER-90234 Allow jsTestName() for SELinux tests (#24899)
(cherry picked from commit 2413ea8f3bec5aa5c87bb9879aefa803585d5d37)

GitOrigin-RevId: 017611b1d5b7197d50d4783e39558774c8d767ba
2024-07-18 19:32:06 +00:00
Brett Nawrocki
36b6c57f1c SERVER-90217 Consider setting orphanCleanupDelaySecs on suites with b… (#24883)
…alancer and failovers (#21955)

(cherry picked from commit 4781431cd3116a354a601a5e16292197a74dd1e0)

Co-authored-by: Randolph Tan <randolph@10gen.com>
GitOrigin-RevId: d61a0a8f9d84b7278e533dd7c3ef5bbd605ee29e
2024-07-17 18:50:26 +00:00
Pierlauro Sciarelli
c996600af8 SERVER-91195 Provide a generic backportable solution not to miss top-level timeseries collection options (#24882)
GitOrigin-RevId: f3ded215156f5db677099ad5f3b6315be8379571
2024-07-17 16:35:36 +00:00
SimonEismann
10dd029836 SERVER-92527 Fix generate_all_variant_auto_tasks on sys-perf (#24878)
This PR fixes the generate_all_variant_auto_tasks task on sys-perf by
re-adding the modules and backporting a sys-perf change.

---------

Co-authored-by: Trevor Guidry <trevor.guidry@mongodb.com>
GitOrigin-RevId: c948e34d7e6e876998a4eb96c37572603bf9e1cb
2024-07-17 16:35:19 +00:00
Joan Bruguera Micó (at MongoDB)
cf1311de4a SERVER-92186 Implement simple API to get/set app_metadata from/to wiredtiger config strings (#24869)
GitOrigin-RevId: 7309fc69b33b7980caaaecef45dc4a8bb3a992c9
2024-07-17 13:02:41 +00:00
Zixuan
305467a354 SERVER-92131 Fix index missing during SBE multiplanning (#24505)
https://spruce.mongodb.com/version/669207221748d400072bd577/tasks?page=0&sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC
(The timeout task is generated fuzzer test, each test runs slower than
before, but this is not related to changes in this PR, [this
patch](https://spruce.mongodb.com/version/6695733f52ea7700073f28c9/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)
reverted the change but still timed out)

---------

Co-authored-by: Catalin Sumanaru <catalin.sumanaru@mongodb.com>
GitOrigin-RevId: 475101b19cda96947dc3145be5d4e3b7ccf4688d
2024-07-16 20:02:45 +00:00
HanaPearlman
52c7d3af54 SERVER-92199: Ban change_stream_lookup_single_shard_cluster.js from stepdown suites (#24520)
GitOrigin-RevId: 9c36f64d9caf38c866e37190e6a53ff7428c53b6
2024-07-16 17:47:54 +00:00
SimonEismann
fd730c5138 SERVER-92377 Clean up the system_perf.yml configuration (#24793)
GitOrigin-RevId: 034d9022eaf77fa04f3d58e595ce8330904bb7a9
2024-07-16 17:37:30 +00:00
Haley Connelly
cbc9d57bea SERVER-91501 Allow absence when trying to deregister TTL index from TTLCollectionCache (#23822) (#24711)
Removes assumption that TTLInfo for an index must be tracked by the
TTLCollectionCache when _deregisterTTLInfo() is called.

GitOrigin-RevId: e6bb4b13ea494760a08aa5ecbcf3ceaf5f11ed39
2024-07-16 13:36:34 +00:00
Jack Mulrow
524d3cf0ef SERVER-84026 Ignore ConflictingOperationInProgress in random_moveChunk_update_shard_key_kill_sessions.js (#24644) (#24754)
(cherry picked from commit addb2a31c7267cd42d79deed65682bda809e1cd8)

GitOrigin-RevId: 113347830a429b5535685225d489bc4ed277b096
2024-07-15 19:57:31 +00:00
Gregory Noma
93491f5827 SERVER-92382 Allow temporary uniqueness violations on prepareUnique indexes during oplog application (#24633) (#24729)
(cherry picked from commit afbaf9cf77ea401a68939eec3649cea1c6afad35)

GitOrigin-RevId: 471965e9486b1f728983f485d581c755c1b16f8e
2024-07-15 19:57:14 +00:00
Alex Li
8f6a388de8 SERVER-89711 proxy_protocol.js should handle errors when running proxyprotocol.server (#24751)
…yprotocol.server (#21560)

(cherry picked from commit 20b8e4a8e27962c6604600560fbbfa2910f9666c)

GitOrigin-RevId: 532247395b5ea35d176631f9e4fad5c154a1d397
2024-07-15 17:57:11 +00:00
Alexander Ignatyev
cda2c453b0 SERVER-92417 Enable indexed plans for expressions referencing system … (#24744)
…variables (#23656)

This commit is meant to achieve the effects of SERVER-83524 but on the
7.3 branch and basically is a frontport of SERVER-91625, which has done
the same changes for 7.0. Since the 7.0/7.3 branches still have the SBE
plan cache enabled, we cannot just re-enable the constant folding of
ExpressionFieldPath. This commit disables queries with expressions
referencing system variables from running in SBE. This allows us to
safely re-enable the constant folding optimization since queries will
use the classic engine and thus classic plan cache as well, avoiding the
problems encountered in SERVER-74264.

Anything in this description will be included in the commit message.
Replace or delete this text before merging. Add links to testing in the
comments of the PR.

🌲

[patch](https://spruce.mongodb.com/version/66952a8e69b85a000755add0/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)

(cherry picked from commit 019517b0a3b534288eeda23068c8af850760428c)

Co-authored-by: Ben Shteinfeld <ben.shteinfeld@mongodb.com>
GitOrigin-RevId: 4b0214e317107d421bdf9379cb1ef8dcb61d5d99
2024-07-15 16:17:27 +00:00
Erwin Pe
0a89fd23f9 SERVER-92254 Fix deadlock in _shardsvrCompactStructuredEncryptionDataCommand (#24665)
(cherry picked from commit 77c7978ce360f4405b8616d33ef79b8187cc86ca)

GitOrigin-RevId: 4733860a9a4b00a73aa22f511819e4f97e1fb843
2024-07-12 21:34:16 +00:00
Daniel Moody
952b345fd2 SERVER-88350 test_packages should only install_compass on the supported platforms (#20273) (#24675)
(cherry picked from commit ce91ba62b7dd3259ec297234f4af4c330f79f1c0)

GitOrigin-RevId: 48f9631efee3bdeac50e0e5656f047e955e033bc
2024-07-12 21:27:24 +00:00
Abdul Qadeer
37ae3c32ae SERVER-89529 Preserve namespace from donor session oplog entry when resharding (#24649)
Co-authored-by: ben-gawel <167240029+ben-gawel@users.noreply.github.com>
GitOrigin-RevId: d2b4bc45e2c61e6d9b63000a0035f87a46238cff
2024-07-12 21:27:08 +00:00
Nick Zolnierz
9bfeedbba4 SERVER-91894 Fix views_basic.js to reference correct database name (#24048) (#24501)
(cherry picked from commit 7104eb78de8af51d31d61e1f3e2e8e511c82b801)

GitOrigin-RevId: affd40f0dbfbc694f24ea4a729c87eaf21c29014
2024-07-12 20:48:15 +00:00
SimonEismann
e76faabe3f SERVER-92264 Remove mongo-tools module from sys-perf (#24581)
Cherry-pick did not apply cleanly due to the enterprise module being
present in 7.3. I'll get a patch up to be on the safe side.

GitOrigin-RevId: 809aaf9cfc60dc02052fe8ce164013e355282478
2024-07-12 20:47:58 +00:00
Jack Mulrow
f7d430ee91 SERVER-92159 Ignore InternalError in setfcv_aborts_reshard_collection.js (#24359) (#24609)
(cherry picked from commit 8e9f465742210cf17aac8f01558a04d33994d57b)

GitOrigin-RevId: c4c29f1d913c53751b090971051a34b0c9e38a7c
2024-07-11 21:03:01 +00:00
SimonEismann
724bee1e6a SERVER-88255: Sys-perf: Replace mongotools compilation with the download of a static artifact (#24585)
This PR backports the switch from compiling mongo-tools on sys-perf to
downloading them.

Co-authored-by: roganamy <93335130+roganamy@users.noreply.github.com>
GitOrigin-RevId: 0e8eaeafa7c85fbda1fc09a6781b1de486b234e6
2024-07-11 21:02:45 +00:00
Ruoxin Xu
d61b6e40c8 SERVER-91701 Robustify max_time_ms_does_not_leak_shard_cursor.js test (#24320)
GitOrigin-RevId: 947f82b0f56ed8c37e0de4efe849b5f69a96b995
2024-07-11 13:12:49 +00:00
Zixuan
aa1ab0ffaf SERVER-91919 Reduce memory consumption for change_stream_pit_pre_image_deletion_asymmetric.js (#24442)
Backport #24296

https://spruce.mongodb.com/version/668f01203a5be1000708ea3d/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC

GitOrigin-RevId: 02e1bbda0885ada90f4cc0d8e335dc7cc6569561
2024-07-11 13:12:32 +00:00
Brad Cater
13bb8d6d02 SERVER-91818 More forcefully step down the config shard's primary to v7.3 (#24528)
[SERVER-91818](https://jira.mongodb.org/browse/SERVER-91818)

This is the backport of https://github.com/10gen/mongo/pull/24029 to
v7.3.

On slow builds like enterprise-rhel80-debug-tsan (and other rhel80-debug
and windows-debug builds), a data-bearing config server can fail to
elect a primary because secondaries don't replicate fast enough to catch
up between writes. Instead of asking one of the secondaries to step up,
instead ask the primary to step down, which will trigger an election.

GitOrigin-RevId: 385d99db0b76dc2bf1cdb08110531f6a1672421d
2024-07-10 21:41:55 +00:00
fotiniAlvanaki
29f802a63a SERVER-92052 Skip tests in SBE (#24397)
There is a bug in SBE setWindowFileds stage in v7.3 that makes some
range tests fail. The bug has been fixed in v8.0 with the ticket
SERVER-86373 but the fix is not likely to be backported to v7.3 because
the affected code is behind a flag.

GitOrigin-RevId: 24d2f5e12503d281ec0a5d1157a95473b564bd44
2024-07-10 20:17:46 +00:00
Gabriel Marks
225617a7ac SERVER-90391 Fix license details in READMEs (#24535)
Enterprise PR:
https://github.com/10gen/mongo-enterprise-modules/pull/1999

https://spruce.mongodb.com/version/668c19cbd3f7f900071b083c/tasks

GitOrigin-RevId: 376c1d99d628ada1ad0dcced321641f52605adf3
2024-07-10 20:17:30 +00:00
vstojkovic-mongodb
31da2631d0 SERVER-91831 uassert in NetworkInterfaceTL::setTimer can crash the server (#24429)
GitOrigin-RevId: d7b817592d233a38d47fd7f021890bf151d4d8b3
2024-07-09 19:28:27 +00:00
Matt Olma
e82beb8d90 SERVER-92085: Skip tailable cursor invalidation test for config fuzzer (#24387)
GitOrigin-RevId: 4d17e513a02cd6b177a5471dd18714dcdfd4495e
2024-07-08 18:50:21 +00:00
Ivan Fefer
5157b67db1 SERVER-91784 Remove missing values from arrays after projection (#24340)
Co-authored-by: Mihai Andrei <mihai.andrei@mongodb.com>
(cherry picked from commit c5c3e294a3c859a917e74da8a9992ee3729c7e5f)
GitOrigin-RevId: 247ab19d18565ddec097e93235062342fc235953
2024-07-05 16:10:03 +00:00
Gregory Noma
03b2051fe6 SERVER-84699 SERVER-92045 Add a check to validation to check for mixed-schema buckets for time-series (#24288)
(cherry picked from commit fc2c43a282d036706256b4ae2ca548d903372b7d)
(cherry picked from commit e55fe125e18567ea00427200ed4b755100833952)

Co-authored-by: cannonmongo <cannon.caspar@mongodb.com>
GitOrigin-RevId: ed93adfaf5074f86cb9eeae9c7050417ea104ece
2024-07-04 03:56:16 +00:00
Dominic
cea6328b81 SERVER-90984: Fix exhaust hello stream to process SplitHorizonChange if response is from stale horizon. (#23485) (#23888)
backport for
[SERVER-90984](https://jira.mongodb.org/browse/SERVER-90984) and
[SERVER-91766](https://jira.mongodb.org/browse/SERVER-91766)

Covers back port tickets
[BACKPORT-21410](https://jira.mongodb.org/browse/BACKPORT-21410) and
[BACKPORT-21897 ](https://jira.mongodb.org/browse/BACKPORT-21897)

GitOrigin-RevId: 8fc810b0aad5c5c2438f5dcda0df48dd715f6a7d
2024-07-03 23:33:15 +00:00
HanaPearlman
b4d93453e3 SERVER-91859: Don't propagate CommandOnShardedViewNotSupportedOnMongod errors to user in analyzeShardKey command (#24219)
GitOrigin-RevId: 607ccf3083c90f170a87579b317af1dcdc46c9cf
2024-07-03 23:32:58 +00:00
Projjal Chanda
24d7414b49 SERVER-90958: Group documents with same grouping keys in the same buc… (#23704)
…ket in bucketAuto (#23161)

# Issue
https://jira.mongodb.org/browse/SERVER-90958

# Description

Normally documents with the same bucket grouping keys should fall into
the same bucket. However there is an edge case in the implementation
when 1) there are multiple duplicate keys with values 0 or infinity, AND
2) the granularity is explicitly specified, the documents get spread
over multiple buckets. This fixes the behavior.

# Testing

https://spruce.mongodb.com/version/6672e49066dcd80007cc6b45/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC

GitOrigin-RevId: 6c2ddfa42e44476a2e2340cafd33bc0ed72c9985
2024-07-03 21:29:57 +00:00
Lynne Wang
f0ee4bb2aa SERVER-89844 Make $jsonSchema with dollar fields in all keyword fields reparseable (#23123) (#23790)
# Issue

SERVER-89844

# Description

This ticket makes all $jsonSchema expressions with dollar-prefixed field
names reparseable by wrapping them in a `$_internalDollarField` parser
keyword at serialization time. Upon reparsing, the parser will desugar
this into the original expression, without erroring on dollar-prefixed
field paths.

# Testing
- Round trip serialization unit tests in
`expression_serialization_test.cpp`
- Integration tests in `query_stats_json_schema.js`
- evergreen
[patch](https://spruce.mongodb.com/version/666217cffd3cc200074878bd/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)

<!--
Available Evergreen Comment Commands
evergreen patch - attempts to create a new PR patch that reruns on each
new commit; this is required to create a PR patch when only manual PR
testing is enabled
evergreen keep-definitions - reuse the tasks from the previous patch in
subsequent patches. Use this after you modify a patch's tasks. evergreen
reset-definitions - reset the patch tasks to the original definition
evergreen refresh - resyncs PR GitHub checks
evergreen help - comments the above info
 -->

Anything in this description will be included in the commit message.
Replace or delete this text before merging. Add links to testing in the
comments of the PR.

GitOrigin-RevId: bf63ef4429494c00c2cf13290cc2cc3e43f42d53
2024-07-03 21:12:54 +00:00
Adityavardhan Agrawal
c1229b473d SERVER-91778 Do not close cursor in shell when batch is filled till l… (#24123)
…imit (#23995)

(cherry picked from commit 8ef0f317426ea8c87bdb3020657c1e407bfda79e)

GitOrigin-RevId: c3b42194f86d4fe3527301169080a8ddcf070eca
2024-07-03 21:12:38 +00:00
Matthew Boros
dab5954f03 SERVER-91223 NumberDecimal $log should use ln(input)/ln(base) for generic base value (#24185)
GitOrigin-RevId: b341196d31a0ad7f6517e01d2a84eb2c84746ba5
2024-07-03 18:19:24 +00:00
Ryan Berryhill
33e3db77fa SERVER-88439 Fix a use-after-free when cloning DocumentSourceLookup (#20342) (#24067)
(cherry picked from commit 5766a49f3c7f2d615dcc71e8804251b83dee2a8b)

Co-authored-by: Ryan Berryhill <ryanberryhill@users.noreply.github.com>
GitOrigin-RevId: ad36bfbb8fb3610f6bdaa191fdc43b957ed784e2
2024-07-03 17:12:55 +00:00
Mindaugas Malinauskas
9afe59cde0 SERVER-88811 Made parsing of oplog entries resilient to incompatible oplog entry data structure evolution when opening a change stream (#23357) (#23798) (#23992)
# Issue
[SERVER-88811](https://jira.mongodb.org/browse/SERVER-88811)

# Description
Introduced an oplog entry parser (OplogEntryParserNonStrict) that parses
individual fields on demand. Replaced usage of IDL generated parser with
this newly introduced parser when checking if oplog entry that is
required for a change stream has fallen off the oplog or the change
collection.

Co-authored-by: Mindaugas Malinauskas
<mindaugas.malinauskas@mongodb.com>
(cherry picked from commit bb6fd2a891756597ca5160a278366361f07f5e22)

Co-authored-by: Mindaugas Malinauskas <mindaugas.malinauskas@mongodb.com>
GitOrigin-RevId: 5d5866dd8751cc999f7c406429b6620638c195f4
2024-07-02 23:39:48 +00:00
Antonio Fuschetto
f86e6c6d4a SERVER-86669 Invalid authoritative knowledge on secondary node after move primary locally creates the collection on the primary shard (#23583)
The `movePrimary` operation may need [to create a representation of the
sharded
collections](eff30b3a35/src/mongo/db/cloner.cpp (L600))
in the new primary shard during the cloning phase. When creating these
collections, an operation observer will set the filter metadata to
`UNKNOWN`, but [only on the primary
node](https://jira.mongodb.org/browse/SERVER-86669#:~:text=only%20on%20the%20primary%20node).
Therefore, secondary nodes will retain the state they previously had.
This represents incorrect version protocol behavior.

GitOrigin-RevId: 7694db2dd11eb4d341b9dc0df4986d0131a98f37
2024-07-02 23:06:16 +00:00
romanskas
302011b9b3 SERVER-91406 Allow $match to move ahead of mongoS change stream stages (#24200)
This change allows $match to always move ahead of
$_internalChangeStreamEnsureResumeTokenPresent and
$_internalChangeStreamHandleTopologyChange stages. This is a
precondition for the $changeStreamSplitLargeEvent stage. It also will
move the problematic $match stages to the shard pipelines improving the
overall change stream performance. Before this change some $match
expression (e.g., $jsonSchema) would not move ahead of the
aforementioned stages.

Anything in this description will be included in the commit message.
Replace or delete this text before merging. Add links to testing in the
comments of the PR.

GitOrigin-RevId: cbfd00d3b0cae2a1e195f3e2b4e8fb2f2aa9c1ed
2024-07-02 14:53:36 +00:00
Erin McNulty
ce5a11004a SERVER-91985 Fix race in egress_connection_acquisition_to_wire_metrics.js (#24173)
GitOrigin-RevId: 2970331037133748e380a943456887f21ff70ce7
2024-07-01 23:35:43 +00:00
Alex Li
96ed9a9773 SERVER-91758 mongos_rs_shard_failure_tolerance.js retries NetworkInterfaceTimeLimitExceeded for a sharded find command on versions earlier than 8.0 (#24064)
Getting a timeout in connection pool code (NITLExceeded) instead of
HostUnreachable when targeting a downed host can cause the command to
fail early when it could be retried and target a different host.
mongos_rs_shard_failure_tolerance.js should retry in this scenario.

Patch:
https://spruce.mongodb.com/version/667f169153ee0a00079d2e7b/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC
GitOrigin-RevId: 04bdb9454148c3654b408de6f9feb5ebd252049f
2024-07-01 18:29:47 +00:00
Cheahuychou Mao
3c06ff6efa SERVER-91817 Make analyze_shard_key.js workload more robust (#23983)
[SERVER-91817](https://jira.mongodb.org/browse/SERVER-91817)

(cherry picked from commit 00e48e55ccbc0a62c5867c4d13b44cbec0a38b67)

GitOrigin-RevId: a83f545a8d168bffbc25690620e6e38a0e01aec3
2024-06-28 21:11:39 +00:00
James H
6f71112f13 SERVER-91781: Wait for replication in merge_let_params_size_estimation (7.3) (#23961)
Backports #23903

GitOrigin-RevId: cd1134daa0f9652c516bfd50b611c142b0c0da17
2024-06-28 17:04:34 +00:00
HanaPearlman
8c44bb827a SERVER-91512 Preserve unowned values in BlockToRow::doSaveState (#24083)
This PR address a problem in `BlockToRow::doSaveState` which fails to
preserve unowned values in a block when there are still some values not
yet deblocked.

The fix is to ignore the status of `slotsAccessible()` in
`BlockToRow::doSaveState` to ensure that any unowned values remaining in
the block are preserved.

In order to reproduce the issue in unit test, a new SBE stage is
introduced -- VirtualScanStage. This stage mimics the behavior in a
collection scan which releases memory from the cursor in getNext() and
saveState(). With VirtualScanStage, we are able to reproduce the failure
in the added unit test `BlockToRowNoValuesFilteredObjects`. The issue
was also reproduced in a JS integration test,
`timeseries_cursor_batches.js`, which runs a multi-batch aggregation
over a single block of documents.

Co-authored-by: Chi-I Huang <chii.huang@mongodb.com>
Co-authored-by: Hana Pearlman <hana.pearlman@mongodb.com>

---------

Co-authored-by: Chi-I Huang <8468853+chiihuang@users.noreply.github.com>
GitOrigin-RevId: 6ee54a295e81363bf9e3a6e6413f1e207fca8c8c
2024-06-28 14:19:15 +00:00
Nick Zolnierz
56df474187 SERVER-91436 Remove unused _internalCollation parameter to $lookup aggregation stage (#23930) (#23996)
(cherry picked from commit bebf7800f18f48872fae8607701cc572c32e587c)

GitOrigin-RevId: 6f327dc71b4d2b5087994130200f4ec93e211316
2024-06-28 13:00:46 +00:00
Ruoxin Xu
ca0eb3cb22 SERVER-37164 Prevent a sparse index being used on $gte and $lte queries with null (#23912)
GitOrigin-RevId: ad52cc929dafa4a0c20ce52d8310ed755619c6c9
2024-06-26 21:02:17 +00:00
fotiniAlvanaki
850c127353 SERVER-91254: Compute threshold as double when value is double (#23963)
In windowsFunction in classic we always convert the base value and the
delta to decimal and compute the threshold of the window as a decimal
value. When later we compare the value against the threshold to decide
whether the document is inside the window we convert the value and the
threshold to double and compare two double values. Converting a double
to/from decimal might result in losing precision and when the delta is
much smaller than the value we might end up trying to remove a document
that was never added in the window. With this change we avoid converting
from double to Decimal to double by computing the threshold as double
when the value is a double.

Co-authored-by: Foteini Alvanaki <foteini.alvanaki@mongodb.com>
(cherry picked from commit 04b3a26e15dea01530f8cb4f2d4ff60439420879)
GitOrigin-RevId: 2824965511d652a69b171805634086854e42ac2c
2024-06-26 19:25:25 +00:00
fotiniAlvanaki
5244c83f17 SERVER-91699 Remove invariant in decrementMemUsage (#23954)
Estimated memory can be inaccurate since it is not updated when the
cache size changes.

---------

Co-authored-by: Foteini Alvanaki <foteini.alvanaki@mongodb.com>
(cherry picked from commit d7183d35874621745d6be6603cd768d5bb549ab3)
GitOrigin-RevId: ccef9d71450b46a40148485ebdd11a7ed4d6be88
2024-06-26 19:25:09 +00:00
Catalin Sumanaru
c8e9f20da4 SERVER-90147 Upgrade timelib.h to 2022.10 and timezone files to 2024a
Updates timelib.h to the latest available named version. Additionally
modifies the import script such that it always downloads the latest tz
dbs.

Changes from the original commit to `master`:
* `sbom.json` - deleted - does not exist at this point in time
* `BUILD.bazel` - deleted - changes we're translated to `SConscript`

No changes from `v8.0`.

GitOrigin-RevId: 93858dfa4829f700932447e54bc13543a5fb256e
2024-06-26 17:21:52 +00:00
Samuel Mercier
9be8e57f39 SERVER-89344 Fix explain output for '$unionWith' queries
GitOrigin-RevId: 852cc97f80bce986d37c22411faf2e8860d512d6
2024-06-26 12:37:57 +00:00
Alexander Ignatyev
a04d516b10 SERVER-91700 Use unoptimized match expressions for upsert (#23721)
`update` operation with `upsert: true` upserts a new document if the
filter does not match any documents. The new document is the combination
of fields from the filter and the update expressions. The query engine
ignores any fields in the filter which are behind negations ($nor,
$not). However, the Boolean simplifier, introduced in 7.3, can simplify
such expressions and remove some negations.

Let's take a look at the filter expression with root `$nor`:
```
{$nor: [{$or: [{"x": 1}, {"y": 2}]}, {"x": {$ne: 3}}]}
```
since everything is behind `$nor` the query engine cannot extract any
field values for the document to upsert. However, the Boolean simplifier
will simplify such expression to
```
{x: {$eq: 3, $ne: 1}, y: {$ne: 2}}
```
Now the query engine can extract `{x: 3}` for the document to upsert.
This brings the issue of inconsistent behaviour depending on whether the
simplifier enabled or not, which is incorrect since the simplifier
shouldn't change the query's semantics. We decided to disable the
simplifier for upsert operations until we come up the better solution.

Signed-off-by: Alexander Ignatyev <alexander.ignatyev@mongodb.com>
GitOrigin-RevId: 8d2d9fd0aedb93cbffe8b809fcb10daf90ae21a1
2024-06-21 21:48:02 +00:00
David Daly
9425c45047 SERVER-91499 Append -sys-perf to version string for sys-perf builds (7.3) (#23719)
GitOrigin-RevId: 0c5a38b8d26290d5c5d99902be55dbdd97a03f13
2024-06-21 17:49:55 +00:00
Pierlauro Sciarelli
5ab9f8a00e SERVER-91193 + SERVER-91411 Disable timeseriesBucketingParametersHaveChanged feature flag (#23633)
GitOrigin-RevId: 77e2208b0eb0595d3efe11c2209d530bc3686bc8
2024-06-21 07:58:43 +00:00
Steve McClure
1d48d2a826 SERVER-91324: [v7.3] Pin to v0.2.0-jepsen-mongodb-master (#23738)
Backport of 93417ae140d886e5f173cfc5879620550abdbe1c and
fc943276edf871ac68a99aba02f236fbd0be3135

GitOrigin-RevId: f6355f181a49e68dda1a5f7325625ead8cb0c08a
2024-06-20 20:08:16 +00:00
Christopher M. Wolff
607b032f7c SERVER-85532: fix queryStats for invalid $hint syntax (#18225) (#23748)
(cherry picked from commit 4699fc258d5ee2f46584139989d49f6a64a39ee0)

This was a straightforward backport of SERVER-85532, with no merge
conflicts. These changes were already reviewed in #18225.

GitOrigin-RevId: 3f71ad63b22daf136f38f140f08547c9ab6f91eb
2024-06-20 19:14:45 +00:00
Matt Kneiser
f3913c49ca SERVER-84143 Improve Windows Debugging capabilities for BSON and core dumps (#23745)
# Issue

BACKPORT-20195

# Description

Backport of SERVER-84143.

(cherry picked from commit eee090f7412b4d14b739626290452490916b84de)
(cherry picked from commit 645274512d49fabb47946b810ae88960e529f901)

GitOrigin-RevId: e26188e377140c3b82ac4c4c343fa5d611df0d1e
2024-06-20 18:52:27 +00:00
Matt Kneiser
9e23fd1ddd SERVER-86329 improve compile_upload_benchmarks task (#23743)
# Issue

BACKPORT-21676

# Description

Backport of SERVER-86329.

(cherry picked from commit 556cad8e3efd99eee15030edeeb4503ae455e090)

Co-authored-by: Daniel Moody <dmoody256@gmail.com>
GitOrigin-RevId: 5a358d835e4b0888f50b12dfa45d252031d50d64
2024-06-20 18:36:49 +00:00
Matt Kneiser
e2b602e51d SERVER-88530 spawnhost: fix gathering of unittest binaries (#23742)
# Issue

BACKPORT-21678

# Description

Backport of SERVER-88503.

(cherry picked from commit 80d6d953905b3c0dd724357e1d7b96ea11dca536)

Co-authored-by: Trevor <trevorguidry6@gmail.com>
GitOrigin-RevId: 072c4520e17908eba2edbea9661d8eb0abac77ac
2024-06-20 18:36:33 +00:00
Ronald Steinke
83e929a54d SERVER-91687: Fix AsioSessionConstructor debug logging numbers (#23694) (#23730)
Fix a miss for SERVER-90790

GitOrigin-RevId: 79d0f040ccac2ecc1702e8e0dec6d06247167e75
2024-06-20 17:54:00 +00:00
Steve McClure
1f1ba96749 SERVER-91635: [v7.3] Remove eMRC that is no longer used by the tests (#23722)
This flag doesn't do anything, but now that the tests aren't populating
its value (using v0.2.0 from https://github.com/10gen/jepsen), another
error is triggered:
```
Expected boolean but found string:  for option: replication.enableMajorityReadConcern
```

https://spruce.mongodb.com/version/66719df880beab0007b37f96/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC
(cherry picked from commit 53c124f7bde44db686a4a361206895e46506a8f0)

GitOrigin-RevId: f9a17fcbcf186e2b4e997fdbcae10ccd13b337df
2024-06-20 15:53:04 +00:00
Adam Farkas
fe79ac77c4 SERVER-90330 Creation of DDL coordinator hang indefinetly if executed on secondary node (#23708)
SERVER-90330 Creation of DDL coordinator hang indefinetly if executed on
secondary node (#22506)

SERVER-91247 Ensure that DDLCoordinator creation does not survive node
stepDown-stepUp (#23089)

SERVER-91366 Fix possible crash in coordinator completion (#23272)

Co-authored-by: Tommaso Tocci <58224719+toto-dev@users.noreply.github.com>
GitOrigin-RevId: bd59cb82ffb2611236976bfeeb6009bd38b08b92
2024-06-20 13:28:42 +00:00
Daniel Gómez Ferro
25ecedcbc8 SERVER-91412 Ensure returned BSONObj lives long enough. (#23703)
GitOrigin-RevId: 9e633bf603c7dedb22a1a18c75ea2238d434cbe4
2024-06-20 08:04:58 +00:00
Ronald Steinke
a3dd464b31 SERVER-90790: Log exceptions in CommonAsioSession constructor (#22518) (#23573)
# Issue

SERVER-90790
BACKPORT-21193

# Description

Logging code to help debug BF-33378.

# Testing

evergreen patch run

GitOrigin-RevId: ad78c82db738057fc7468b327bb430753e789c12
2024-06-19 14:39:02 +00:00
romanskas
5eacc4625c SERVER-91258 Increase oplog size in change_streams_split_event tests (#23675)
The default oplog size in deployments created with ShardingTest is 16MB,
which is not enough to accommodate 4 nearly 16-MB large changes (2
updates and 2 replaces) created by this test. As a result, the oplog
might get truncated during the test which leads to sporadic test
failures. Therefore, we need to increase the oplog size.

GitOrigin-RevId: f9d781c5c6aeb92a6e06a7d02fc02d71c64cb0d3
2024-06-19 01:56:00 +00:00
Catalin Sumanaru
90f42e8278 SERVER-91379 Re-introduce eslint rule for missing semicolons (#23632)
Currently the merge queue checks fail on missing semicolons on v7.0, but
passes for v7.3, v8.0 and master. This backport re-introduces the eslint
rule to v7.3.

GitOrigin-RevId: 5a09ce923b2073347c9ab0f8cde8b5ab9ca4f613
2024-06-18 16:51:39 +00:00
Erin McNulty
fa05d574e4 SERVER-91558 Make HedgeCancellationTest resilient to operation interuption (#23637)
GitOrigin-RevId: b4cf66fe106e657e48a30ee5448263836a05f025
2024-06-18 15:27:15 +00:00
James H
f14615907c SERVER-91494: Avoid past-the-end access in DocumentSourceBucket (#23578)
DocumentSourceBucket::createFromBson checks the first character of the
string given for groupBy, but does not ensure that the string is not
empty.

Anything in this description will be included in the commit message.
Replace or delete this text before merging. Add links to testing in the
comments of the PR.

----

Original PR: #23495

----

[evergreen](https://spruce.mongodb.com/version/66705050ef83b80007ec468a)
green.

GitOrigin-RevId: 2034d734099733f2e142a96bf4f7f38eb11c3fb6
2024-06-18 14:04:52 +00:00
Frederic Vitzikam (fredvitz)
febf4f27e2 BACKPORT-21295 [v7.3] Revert SERVER-71520 (#23448)
SERVER-90777

Revert the 2 commits in SERVER-71520.

(cherry picked from commit d34c160a16aa586a07ae613657ff5ced7a2473a2)

GitOrigin-RevId: 6a88f518d51ea80cd220279ef0a350e79c3b4f77
2024-06-18 11:25:47 +00:00
Allison Easton
844d72aa23 SERVER-91203 AutoGetters should establish capped snapshots for secondary namespaces (#23623)
(cherry picked from commit 8426ffda43d081c4ee4b92a9fe3f43fa13fe77c7)

GitOrigin-RevId: 1402d683e9ea00600015803443208d1c6726c315
2024-06-18 10:13:07 +00:00
Yoonsoo Kim
dffd8cdcee SERVER-90995 Do not make the shadowing metaField a computed mete field (#23592)
### Issue

SERVER-90995

### Description

This is a backport of SERVER-90995. Only
`backports_required_for_multiversion_tests.yml` had a conflict which was
straightforward to resolve.

#### Original description
Do not make the shadowing metaField a computed mete field

### Testing

https://spruce.mongodb.com/version/667077eb1bc6680007f10258/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC

(cherry picked from commit 8f18340f21eee375418be103555642ed817cd026)

GitOrigin-RevId: acf2a04ec0c0ef598a96d9e041d478fd9ba35dfa
2024-06-17 21:10:17 +00:00
Gabriel Marks
666715822c SERVER-91435: Regenerate test certs with legacy flag (#23490) (#23534)
Co-authored-by: wbradmoore <wbradmoore@users.noreply.github.com>
GitOrigin-RevId: f5325d0b76b91b4c8bbef9bf91785468eb83a802
2024-06-17 15:23:39 +00:00
Will Buerger
a7cfb3aa47 SERVER-91531: Make index_drop_before_running.js wait for replication before confirming index drop on secondary (#23520)
GitOrigin-RevId: 8840f129268c923be486fee045608ac7181abcf9
2024-06-17 12:43:59 +00:00
Ivan Fefer
97348d61c5 SERVER-91339 Load redacted document into cache to avoid cache reallocation (#23502)
(cherry picked from commit 2ed64aa3fe9d168817bfbca2f243f84f8103abdc)

# Issue

SERVER-91339

# Description

If we $$DESCEND in redact, redact processor will create FieldIterator
here:

04b6560034/src/mongo/db/pipeline/redact_processor.cpp (L103)

FieldIterator iterates over DocumentStorage cache directly. However, if
redact expression contains something that will read a lot of fields from
$$ROOT (for example {$objectToArray: "$$ROOT"}), it will re-allocate
cache when executing the expression for sub-document here:

04b6560034/src/mongo/db/pipeline/redact_processor.cpp (L87)

This will make FieldIterator read freed memory.

# Testing

https://spruce.mongodb.com/version/666c5a5d6a980900074be3e8/tasks

GitOrigin-RevId: 5eca187eb943d72fda2910dff98df2db3497fa1a
2024-06-17 07:37:05 +00:00
Cheahuychou Mao
cee4e29d8e SERVER-86829 Make concurrency_replication_for_export_import not run analyze_shard_key.js (#23058) (#23509)
(cherry picked from commit d376d2caa43859fae6a9c8e2b60fa60adf78c972)

---------

Co-authored-by: Christina Castillo <chrisnicollo@outlook.com>
GitOrigin-RevId: c914fd7dec606be80f54bbd449ba60c471c42485
2024-06-14 20:05:27 +00:00
Ivan Fefer
a4f9792381 Revert "SERVER-91339 Load redacted document into cache to avoid cache reallocation (#23443)"
This reverts commit c94eb1337c0d94cd25340aa2694a0b9dbb84be11.

GitOrigin-RevId: 9774fd7abf9a60ff3ed995c53052d6f5cb2a30fd
2024-06-14 15:02:40 +00:00
Catalin Sumanaru
001db85e8b SERVER-90869 Disallow dotted full-path renames for '$elemMatch' expressions (#23108) (#22724)
# Issue
<!-- Jira issue key and link. Entering a SERVER issue will automatically
create a link.-->
[BACKPORT-21227](https://jira.mongodb.org/browse/BACKPORT-21227)
[SERVER-90869 Disallow dotted full-path renames for '$elemMatch'
expressions](https://jira.mongodb.org/browse/SERVER-90869)

# Description
<!-- Please include a summary of the changes and the related issue. Be
sure to include relevant motivation and context. -->
Cleanly cherry-picked from https://github.com/10gen/mongo/pull/22717
(v8.0)

Differences from the `master` version of the patch:
```diff
diff --git a/src/mongo/db/pipeline/pipeline_test.cpp b/src/mongo/db/pipeline/pipeline_test.cpp
index b891b3c1f71..80ee81e3778 100644
--- a/src/mongo/db/pipeline/pipeline_test.cpp
+++ b/src/mongo/db/pipeline/pipeline_test.cpp
@@ -2462,7 +2462,7 @@ TEST(PipelineOptimizationTest,
         "[{$project: {b: '$a', _id: false}},{$match: {b: {$elemMatch: {$eq: 1}}}}]";
     std::string outputPipe =
         "[{$match: {a: {$elemMatch: {$eq: 1}}}},{$project: {b: '$a', _id: false}}]";
-    assertPipelineOptimizesAndSerializesTo(inputPipe, outputPipe);
+    assertPipelineOptimizesTo(inputPipe, outputPipe);
 }

 TEST(PipelineOptimizationTest,
@@ -2483,7 +2483,7 @@ TEST(PipelineOptimizationTest,
     {$match: {"reshapedArray": {$elemMatch: {$eq: 1}}}}
 ]
         )";
-    assertPipelineOptimizesAndSerializesTo(pipeline, pipeline);
+    assertPipelineOptimizesTo(pipeline, pipeline);
 }

 TEST(PipelineOptimizationTest,
@@ -2494,7 +2494,7 @@ TEST(PipelineOptimizationTest,
     std::string pipeline =
         "[{$project: {reshaped: '$document.array.element.deeply.nested.field', _id: false}},"
         "{$match: {reshaped: {$elemMatch: {$eq: 1}}}}]";
-    assertPipelineOptimizesAndSerializesTo(pipeline, pipeline);
+    assertPipelineOptimizesTo(pipeline, pipeline);
 }

 // TODO SERVER-74298 The $match can be swapped with $project after renaming.

```

---
Fixes [HELP-59485 What $elemMatch semantic change between 5.0.26 and
7.3.2 leads to this query result
change?](https://jira.mongodb.org/browse/HELP-59485).

The following pipeline returns different results with optimisations
disabled via the "disablePipelineOptimization" failpoint:

```js
// Collection contains only the document: {outer: [{inner: 0}]}
[
    {
        $project: {
            flattened: {
                $map: {input: '$outer', as: "iter", in : "$$iter.inner"},
            },
        },
    },
    {
        $match: {flattened: {$elemMatch: {$eq: 0}},
    }
];
```
With the optimisation it returns `[]`
Without the optimisation it returns `[{flattened: [0]}]` The rewrite
turns the match expression into `{$match: {"outer.inner": {$elemMatch:
{$eq: 0}}}}` which is not exactly the same in this context due to
implicit dotted array traversal. [[Mongo

docs](https://www.mongodb.com/docs/manual/tutorial/query-array-of-documents/])].

# Testing
<!-- Please describe the tests you ran to verify your changes and
include any links to patches. Consider using `evergreen patch` described
below.-->
[ Link to
🌲Evergreen](https://evergreen.mongodb.com/version/666835c5140d6e0007b7bc21?redirect_spruce_users=true)

Introduced two new test cases inside

[jstests/aggregation/match_swapping_renamed_fields.js](jstests/aggregation/match_swapping_renamed_fields.js):
* JS Tests
* Reproduce the query in question and ensure that the actual result
matches the expected one.
* The `$match` should be split accordingly if it contains other
rename-able expressions.
* The `$match` stage containing the `$elemMatch` should not be swapped
with the `$project` stage.
* The end result following the optimisation is equal to the expected
result.
* The same simplified scenario, but in which the `$project` stage result
is nested in multiple sub-objects.
* Unit tests
    * Adapt the existing unit tests to accommodate the new requirement.

<!--
Available Evergreen Comment Commands
evergreen patch - attempts to create a new PR patch that reruns on each
new commit; this is required to create a PR patch when only manual PR
testing is enabled
evergreen keep-definitions - reuse the tasks from the previous patch in
subsequent patches. Use this after you modify a patch's tasks. evergreen
reset-definitions - reset the patch tasks to the original definition
evergreen refresh - resyncs PR GitHub checks
evergreen help - comments the above info
 -->

GitOrigin-RevId: 310abacc1a38e5f62124f8a223c3bad9242bea3e
2024-06-14 15:02:25 +00:00
Ivan Fefer
8ae1c4f7e4 SERVER-91339 Load redacted document into cache to avoid cache reallocation (#23443)
(cherry picked from commit 2ed64aa3fe9d168817bfbca2f243f84f8103abdc)

\# Issue

SERVER-91339

\# Description

If we $$DESCEND in redact, redact processor will create FieldIterator
here:

04b6560034/src/mongo/db/pipeline/redact_processor.cpp (L103)

FieldIterator iterates over DocumentStorage cache directly. However, if
redact expression contains something that will read a lot of fields from
$$ROOT (for example {$objectToArray: "$$ROOT"}), it will re-allocate
cache when executing the expression for sub-document here:

04b6560034/src/mongo/db/pipeline/redact_processor.cpp (L87)

This will make FieldIterator read freed memory.

\# Testing

Run with all the tests:
https://spruce.mongodb.com/version/666ae4846e219b000781250e/tasks
Run with new test, but without the fix to confirm the issue:
https://spruce.mongodb.com/version/666ae3ccbb6c230007456672/tasks

GitOrigin-RevId: c94eb1337c0d94cd25340aa2694a0b9dbb84be11
2024-06-14 15:02:09 +00:00
Kevin Cherkauer
809a382ac8 SERVER-91362 Perf: Don't copy JS scope obj if cached JsExecution exists (#23474)
SERVER-91362 Perf: Don't copy JS scope obj if cached JsExecution exists

Starting in 5.0.0, an aggregation pipeline that needs a JsExecution
object always retrieves the JavaScript "scope" object every time this
object is used in order to pass it to JsExecution::get() in case the
JsExecution object has not already been created, as it is needed to
create a JsExecution object. However, in sharded clusters this can
result in making a new copy of the scope object for every document the
query processes, and if the scope object is large this can add a
significant overhead.

However, once the JsExecution object has been created for a given query
thread, it gets cached for the lifetime of that thread, so the scope
object is only needed once per thread. Thus there is no need to retrieve
and potentially make another copy of the "scope" object if there is
already a cached JsExecution object.

The problem was introduced in 5.0.0 by the following commit from
SERVER-47398:

a71a2a8bfe

I manually verified the fix on v5.0.23 where it reduced the original
107% performance regression vs 4.4.28 down to only a 3% regression,
using a 2-shard cluster with PSA replication and a query from the
[HELP-58993](https://jira.mongodb.org/browse/HELP-58993) customer who
surfaced this issue, using 100,000 synthetic input documents.

[Patch build

605](https://spruce.mongodb.com/version/66688ca13bf0cb00086a6bbe/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)
passed on this PR. The failures are unrelated:
- 4 known issues
- 1 unrelated config fuzzer failure

[Patch build

608](https://spruce.mongodb.com/version/6669ccbbbb57a70007ec4640/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)
passed on [commit

2](e80cead705)
of this PR. The failure are unrelated:
- 3 known issues
- 1 unrelated timeout while dropping a sharded database

<!--
Available Evergreen Comment Commands
evergreen patch - attempts to create a new PR patch that reruns on each
new commit; this is required to create a PR patch when only manual PR
testing is enabled
evergreen keep-definitions - reuse the tasks from the previous patch in
subsequent patches. Use this after you modify a patch's tasks.
evergreen reset-definitions - reset the patch tasks to the original
definition
evergreen refresh - resyncs PR GitHub checks
evergreen help - comments the above info
 -->

(cherry picked from commit 15eedd38dd05e3d8855d6d5a573aaf1a990dfdae)

GitOrigin-RevId: 4a9741e04ffa95531c0f85f0a2d7568a4739fed9
2024-06-13 19:47:12 +00:00
HanaPearlman
f62c71d334 SERVER-91473: Don't run index_count_scan.js in v7.2/7.3 multiversion tests (#23444)
[SERVER-90461](https://jira.mongodb.org/browse/SERVER-90461) fixed a bug
where certain queries would incorrectly used cached COUNT_SCAN plans.
The fix was not backported to v7.2 because that version is EOL, and we
are now seeing v7.2/7.3 multiversion failures because the bug is still
present on v7.2. We should prevent the v7.2/7.3 multiversion test from
running.

https://spruce.mongodb.com/version/666af4bcbb6c23000745821d/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC

GitOrigin-RevId: 7004624ae49098b6c33f54fa0cd8dbc172c8dece
2024-06-13 19:46:57 +00:00
Serhii Lysenko
1bcce89686 SERVER-84315: Introduce new flag to control spilling strategy in $group (#22679) (#23171)
# Issue

SERVER-84315

# Description

Introduce new flag to control spilling strategy in $group

# Testing

- [evergreen patch run](
https://evergreen.mongodb.com/version/6663269bd1bb1900070d4e28?redirect_spruce_users=true)

GitOrigin-RevId: 8338d5629d378d67f3d358d742aab52afb91e423
2024-06-13 09:41:58 +00:00
Allison Easton
8ae0d1961f SERVER-90086 Fix direct_shard_connection_auth checks for directConnectionChecksWithSingleShard (#23436)
(cherry picked from commit 9780c699263af38787933e79df86e8abaa0566d0)

GitOrigin-RevId: 730c9b9dcf73154cfce60cf2f4456b38270f34fc
2024-06-13 08:48:02 +00:00
Wei Hu
1eea6d924d SERVER-91178 Read name from the catalog if not found in memory (#23337)
# Issue

SERVER-91178

# Description

Implemented the suggested solution to read the catalog at the past PIT.

# Testing

- Patch
[build](https://spruce.mongodb.com/version/6668c765e8cfaa0007f56ba5/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)

GitOrigin-RevId: e0f94fc44cd9a760176658e984fe8bc07f306e17
2024-06-12 21:47:10 +00:00
nandinibhartiyaMDB
25c432c481 SERVER-91114: Fix test to run write cmd before range deletion starts. (#23026) (#23396)
(cherry-picked from bc679952328fb9f2b73ef2c761f74caa8e56e849)
(cherry picked from commit 6264749552010ad9820a1767a4a085e73b8ad7d1)

GitOrigin-RevId: c11113ba7ff0513db57b22e6907a4f71eadc99a7
2024-06-12 20:27:38 +00:00
Josef Ahmad
d1a8b4a6a5 SERVER-81596 Accept range migration recreating index (#23306) (#23369)
# Issue

SERVER-81596

# Description

This change removes an assertion that cannot be held until SPM-2077. See
SERVER-81596's comments for the rationale.

# Testing

https://spruce.mongodb.com/version/66684c218f13a9000731ffac/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC

GitOrigin-RevId: c56803a14410a8ad8584c92f437cf9a12d373aa2
2024-06-12 20:27:21 +00:00
Alyssa Clark
4dd2c82c83 SERVER-91416 Serialize lookup's introspection sub-pipeline during query analysis
GitOrigin-RevId: 342ff1615fd11c2ea78e6d92f23eabe01c1005d1
2024-06-12 16:33:40 +00:00
Trevor Guidry
454b5266ce SERVER-91322 resmoke multiversion-config: set evergreen config options (#23319)
GitOrigin-RevId: 52ca10c51395277beb8f495e61b88dcba0070af3
2024-06-11 22:08:46 +00:00
Wenqin
e33cc9e056 SERVER-89313 [v7.3] Add SnapshotUnavailable to acceptableErrors array… (#23113)
GitOrigin-RevId: 6c5a0753c62630711ccddf782fa281f3350fe6ef
2024-06-11 15:49:50 +00:00
Wenqin
3733243fcc SERVER-91166 [v7.3] Transactions in retryable_write_error_labels.js should update different documents (#23133)
GitOrigin-RevId: 3b8d977b7eeade30625e027e8c3ee5ac67a8796a
2024-06-11 15:49:34 +00:00
fotiniAlvanaki
d56712d6cf SERVER-91028 Revert optimisation that allows index to provide sort key in case of non-simple collation (#22924)
GitOrigin-RevId: 20aac2d2d3c5458606961c1e017624cb6f4ec7d6
2024-06-10 20:19:35 +00:00
Zack Winter
0cb694400a SERVER-90168 Remove LTO Build Variants (#23216)
Backports https://jira.mongodb.org/browse/SERVER-90168

This is triggering https://jira.mongodb.org/browse/DEVPROD-7685 on all
hosts that have run a 7.3 patch.

Even though this is on 7.3, which is fairly low priority, it causes
failures on any patch builds that get a host that has run a 7.3.
compilation since this bug poisons the /tmp directory.

See https://spruce.mongodb.com/host/i-0edde95a5bf3c7650 for an example
of a 7.3 task runner that ends up failing a 5.0 task afterwards
https://spruce.mongodb.com/task/mongodb_mongo_v5.0_amazon2023_sharding_gen_8b150f1669dc9baadd36265a3163b92412889848_24_06_06_21_43_10/logs?execution=0

GitOrigin-RevId: 363df0282d07e50284511aefe168c3c3c9db0554
2024-06-10 20:05:30 +00:00
Sudarshan Muralidhar
597d75c8ec SERVER-90545 Update stitch_support headers to be usable with cgo (#22201) (#23248)
SERVER-90545 Update stitch_support headers to be usable with cgo
(#22201)

GitOrigin-RevId: 6fdad56de8dacfdebee84c48f5706ec8da108321
2024-06-10 18:20:07 +00:00
nandinibhartiyaMDB
8ef9107541 SERVER-82668: Remove failing fsync test from sharding_csrs_continuous_config_stepdown (#23183)
GitOrigin-RevId: 21e11cc38e84f8459c1f923e00e52f4afb03d87a
2024-06-10 15:35:45 +00:00
Evelyn Wu
04e565149c SERVER-91176 Call awaitNodesAgreeOnAppliedOpTime in ignore_dbcheck_in_startup_recovery.js
GitOrigin-RevId: c92f93953427c20772664a2882da4683ffd8eaae
2024-06-07 18:53:19 +00:00
auto-revert-processor
62378eab78 Revert "SERVER-90086 Fix direct_shard_connection_auth checks for directConnectionChecksWithSingleShard (#22432)"
This reverts commit 99aa19032cc94b613d0014f520202d90b77a8f1c.

GitOrigin-RevId: a64372d7ec94760935056e25228793ca63bdc322
2024-06-07 14:32:29 +00:00
auto-revert-processor
6bff565615 Revert "SERVER-90694: Index tables configured with type=lsm crash the server (#23040)"
This reverts commit f79bdec7ebb272c39a638a16c12155c721ce26c2.

GitOrigin-RevId: e0d16df19470efb32057d439d5f8699603e32187
2024-06-07 11:59:11 +00:00
Cheahuychou Mao
c27458f0e7 SERVER-91222 Make temporarily cluster_time_across_add_shard.js retry on KeyNotFound error after restarting the replica set (#23027) (#23127)
GitOrigin-RevId: 26e65b1170e3d7be95928dfd362a0171e3a43428
2024-06-06 22:09:29 +00:00
Trevor Guidry
2a53605780 SERVER-91276 Fallback to public repo for backports_required_for_multiversion_tests (#23122)
GitOrigin-RevId: d4aba195e3ba73d106e623f158cf4044545c49a7
2024-06-06 20:50:22 +00:00
Allison Easton
b0b3b42dee SERVER-90086 Fix direct_shard_connection_auth checks for directConnectionChecksWithSingleShard (#22432)
(cherry picked from commit 9780c699263af38787933e79df86e8abaa0566d0)

GitOrigin-RevId: 99aa19032cc94b613d0014f520202d90b77a8f1c
2024-06-06 15:36:20 +00:00
Stephanie
76a592afad SERVER-90694: Index tables configured with type=lsm crash the server (#23040)
GitOrigin-RevId: f79bdec7ebb272c39a638a16c12155c721ce26c2
2024-06-06 14:45:09 +00:00
Damian Wasilewicz
b95be1b37f SERVER-87267: Increase bucket_catalog memory usage threshold for timeseries_dynamic_bucket_sizing.js on 7.3 (#22954)
GitOrigin-RevId: 6f2620d2cb1b358ce56d346941052f051894300c
2024-06-05 22:40:19 +00:00
naama-bareket
4fa9117add SERVER-91022: Prevent timeseries_groupby_reorder_expr.js from running timeseries_groupby_reorder.js (#22761)
# Issue

[SERVER-91022](https://jira.mongodb.org/browse/SERVER-91022)

# Description

This fixes [BF-33450](https://jira.mongodb.org/browse/BF-33450). The
test loads another test that has backports required, so I refactored the
helper called to avoid loading that test.

# Testing

[Evergreen
Patch](https://spruce.mongodb.com/version/665ddd182911e1000770cce2/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)

(cherry picked from commit 93b82c871003ae6754d500468fc556cd4db21bcb)

GitOrigin-RevId: f143163e6c50d0cc05ea14d8151b031575e783a4
2024-06-04 17:44:03 +00:00
Janna Golden
0f0b056c66 SERVER-91066 Set migrationCommitVersionError failpoint on all configsvr nodes in migration_coordinator_failover_include.js (#22827) (#22931)
GitOrigin-RevId: 0d67b883e6bb14db4a478f5ea7a618f6f94800bc
2024-06-04 16:08:26 +00:00
Adityavardhan Agrawal
ff5cf3023f SERVER-89803 Robustify awaitdata_getmore_cmd.js to filter by specific… (#22877)
GitOrigin-RevId: 8d97365b50e164e69d9d628c11b39f048c3ce33b
2024-06-03 17:57:55 +00:00
nandinibhartiyaMDB
a1718a3af1 SERVER-88417: Use refreshed database cache for dBPrimary (#20881)
(cherry picked from commit 856991a0c4f2aaf809aac2bd796394a7b9245a58)

GitOrigin-RevId: 5371518779a867058361b57cb8d2b8b6b73ebdae
2024-06-03 17:09:12 +00:00
Allison Easton
a6b84012df SERVER-89994 Allow direct shard operations which acquire locks only on non-user collections (#21661)
(cherry picked from commit 506ac62)

SERVER-90438 Fix use after move in direct shard connection checks (#22174)

(cherry picked from commit effa1a0)

SERVER-58300 Add NamespaceString::isPerShardNamespace method (5551f07)

(cherry picked from commit 5482bf7)

GitOrigin-RevId: feae4c6f7d42c82339d581bcc36834d569cbef73
2024-06-03 12:05:20 +00:00
Yoonsoo Kim
8cd47eaed8 SERVER-90833 Fix incorrect bounded sort optimization when time field is renamed by $addFields (#22711)
(cherry picked from commit e398754044fbfbffc1528fce7e38558b254f3cc2)

GitOrigin-RevId: 64e47fd970bea6f1c0f4951cef8755e57f5fa5cf
2024-06-01 05:22:22 +00:00
Alyssa Clark
23576ef75f SERVER-86781 Update query stats upgrade tests to account for 7.0 backport
GitOrigin-RevId: ffc4f45f2655347127ab2a3c290720243a36bcf3
2024-05-31 21:41:02 +00:00
Mihai Andrei
babf7cddb9 SERVER-90985 Add unit test to verify $addToSet update throws uassert … (#22798)
…… (#22736)

…when given invalid BSONArray as argument to $each

# Issue

SERVER-90985

# Description

This commit adds a unit test to verify that verify $addToSet throws a
uassert when given invalid BSONArray as argument to $each.

Testing

Ran the added test locally

GitOrigin-RevId: 7e2d1a0911a438bea46b1967bb01aa26986219ff
2024-05-31 19:38:46 +00:00
Alexander Ignatyev
0467b6e510 SERVER-90747 Handle elemMatch with empty path in plan enumerator corr… (#22799)
GitOrigin-RevId: 4d083c157728ce5d48540a8c628002e6038b845a
2024-05-31 18:25:44 +00:00
Silvia Surroca
d0090d02b3 SERVER-90681 Fix data race over the chunk jumbo flag (#22373)
(cherry picked from commit 8dfcca46a85da8c7b53d4acbeb2c3ffd88558726)

GitOrigin-RevId: 095762c92230dde881eb2e1776321c2c68f3d9fc
2024-05-31 16:04:43 +00:00
Zack Winter
a7aaf47fc8 SERVER-90991 Bump timeout on compile_and_run_unittests_*_quarter (#22700) (#22710)
GitOrigin-RevId: 9db71affad28b57408e724ab3697ac092c006dda
2024-05-30 21:22:04 +00:00
Gabriel Marks
253f890347 SERVER-90248 Add more testing for getClusterParameter: "*" (#22080)
GitOrigin-RevId: 87ccc74c6c9043681714e5b68064c49180d9651c
2024-05-30 19:02:55 +00:00
Justin Seyster
84fc07dd7a SERVER-90988 PrepareExecutionHelper destructor should use the cached value of CanonicalQuery::toStringShort that I specifically added just for that destructor to use
GitOrigin-RevId: 747bb7252aee93c890da2d12ce96145a2bff2b3e
2024-05-30 18:17:17 +00:00
Adityavardhan Agrawal
8c825e5efa SERVER-83712 Do not add in length to plan cache key if there is no so… (#22687)
GitOrigin-RevId: dbd9ca9e9dda7405a03ad0784a28e66a5e239bf8
2024-05-29 17:06:23 +00:00
Catalin Sumanaru
dc2ab9661c SERVER-86405 Exclude 'update_with_pipeline.js' from 'fcv_upgrade_downgrade_sharded_collections_jscore_passthrough' (#22671)
GitOrigin-RevId: 0561c284e99fc57d34606c353074d71c9178252a
2024-05-29 15:59:11 +00:00
Josef Ahmad
72de688433 SERVER-90637 Make makeSnapshot return a committed timestamp (#22328)
GitOrigin-RevId: eb98ea93f4d78ecf76605716b3c7390620c01363
2024-05-29 10:18:20 +00:00
Chi-I Huang
1849279909 SERVER-90394 Change $le/$lte to $gt/$gte in test update_now_clustertime_replset.js (#22313)
GitOrigin-RevId: 80a9b7bf8cd0d697de0545718344d689ddca9c25
2024-05-25 01:50:56 +00:00
Ronald Steinke
7966952eb2 SERVER-89970: Increase request delay in hedged_reads.js (#22481)
GitOrigin-RevId: ca77b5f1439a0539e28209e3f584d32be204a0df
2024-05-24 22:11:08 +00:00
erinzhu001
875fac7e9b SERVER-89496 Collect change stream queries with $_passthroughToShard (#22537)
GitOrigin-RevId: 94e299ae89d2e39f66bad7ef26f69447d5a833bb
2024-05-24 16:23:17 +00:00
Alya Berciu
bcf36c9406 SERVER-90461 Ban bools and "" from auto-parameterization (#22450)
GitOrigin-RevId: f562106d1d66f22b53325519f42fca03619492d3
2024-05-24 15:11:53 +00:00
Arun
3f327da3c2 SERVER-87961 Prevent time-series $group rewrite when the fields are projected out by a $project (#20911)
(cherry picked from commit 790a726a13a6b02508d3d2531b396c30c65c1c02)

GitOrigin-RevId: e6ca5120078a170b09169f6303741e6dd258ca04
2024-05-24 01:33:08 +00:00
Sophia Tan
bb712dcf69 SERVER-90423 Server Initialization Enhancement: trigger signal handler thread pre fast clock source setup (#22120)
(cherry picked from commit 9b29f6b0c82c302282bb0f288382da986f4f34ee)

GitOrigin-RevId: 276a60e3c7ee658aacaf11cda1e3ac9939e67cbb
2024-05-22 21:57:15 +00:00
Brett Nawrocki
77dc50aa5b SERVER-90543 Txn participant locks when configuring opCtx (#22259) (#22478)
GitOrigin-RevId: b464fdaaa0d3796a6a6d082bd4be75b6d54d011e
2024-05-22 21:07:53 +00:00
Matthew Russotto
8458d5a5e2 SERVER-86674 Primary catch-up may believe it is caught up when it is not
(cherry picked from commit 1d25c6d20afd8f4213ab8c03dbb8daf8ef497eb3)

GitOrigin-RevId: 639515f5809bf03ca02f40261eaa78b3ff1116e0
2024-05-22 20:10:22 +00:00
huayu-ouyang
c0b1cf6277 SERVER-88318 Fail dbcheck data consistency check if one batch failed waiting for write concern (#20774)
(cherry picked from commit 55de116aef0c05b74d1ad73871b1a3c9e0896c14)

GitOrigin-RevId: be61aaf24a96e42e5123e67f29cc5a3a70823f87
2024-05-22 20:10:08 +00:00
Brett Nawrocki
b70eb621c1 SERVER-88172 Prevent usages of config as shard (#22457)
GitOrigin-RevId: 2da728ac231d530e73af41ee9ea53d283966c179
2024-05-22 18:57:37 +00:00
Varun Ravichandran
609923e603 SERVER-90513: Always reverify peer certificate before retrieving verified certificate chain
(cherry picked from commit c672a5a9916aa6a4f4d122be7a613b8d0064b5bc)
(cherry picked from commit c073921ef852299e12f4db07935c65c5e47b27af)

GitOrigin-RevId: 2be8fdc184f86ea63ea0a9f89f822e8b0d452e21
2024-05-21 23:15:45 +00:00
Alex Li
869ade391e SERVER-90277 Resmoke tracing set up should catch KeyboardInterrupt and SystemExit (#21973)
GitOrigin-RevId: 015ac47a78614264a54352f8ad46373caa8546e3
2024-05-21 19:06:13 +00:00
Matthew Russotto
32ec455b66 SERVER-90443 Update testing for enterprise aggregate stage
(cherry picked from commit 881733d22d5a4aba4b32f72f5515e7155ad4a754)

GitOrigin-RevId: c51b6d096be50a24874bba047dfaa3a87657c0d9
2024-05-21 18:08:16 +00:00
Adityavardhan Agrawal
776e04d4fa SERVER-90173 Correctly serialize sbe objectid to keyString (#21893)
(cherry picked from commit d438b3b50240a733283f9a1cbee834db64eafa2b)

GitOrigin-RevId: 4b1f6f73d18b8aa94295eb5fe0df6951ded9cb33
2024-05-21 00:21:35 +00:00
kshitij
aebea34f7c SERVER-89744: Resharding adds {locale: "simple"} collation parameter. (#21985)
GitOrigin-RevId: dd8fb20142c798b1d453319441c1f3edefcd87ad
2024-05-17 19:20:43 +00:00
Billy Donahue
1793aaf5e8 SERVER-90599 only search for lzma for system unwind (v7.3) (#22269)
GitOrigin-RevId: 611a34f7685fa39fe7be50dc3447fd2f367bb1c1
2024-05-17 01:27:25 +00:00
Adam Rayner
6b72d8d909 SERVER-90184 Only load included SASL plugins on Windows
GitOrigin-RevId: 9ad548344dcf98074d589f50b258e732fc766bc1
2024-05-16 22:10:18 +00:00
Matthew Boros
a5eb89aff6 SERVER-90417 Disable SBE for Time Series on 7.3
GitOrigin-RevId: aaff635986c2ae284c2ce9909b99c7c006121adc
2024-05-16 20:20:17 +00:00
Sergi Mateo Bellido
036fa2ffe2 Revert "SERVER-86669 Always clear shard versioning metadata on secondaries whenever we create a collection (#21652)"
This reverts commit 4051b57b8437206d3c082ae99dd0ad96c330d6ad.

GitOrigin-RevId: 5ae1b45086a90564e0514a62d2ecff81579b851c
2024-05-16 18:35:29 +00:00
Brett Nawrocki
e7405709b8 SERVER-90376 _fetchBuildIndexMetrics won't throw (#22238)
GitOrigin-RevId: 578225fc32878db7b6158182e5a8866c52ce3777
2024-05-15 22:03:10 +00:00
Joseph Prince
a8147253b8 SERVER-90388 Add incompatible_with_shard_merge to command_let_variables_merge_only.js (#22086)
GitOrigin-RevId: 8bef8970db74ae1d35e20257ea670186667c7d38
2024-05-15 17:14:22 +00:00
ben-gawel
ba4c7581a6 SERVER-89331 Prevent use-after-free issue when creating new opCtx (#21740)
(cherry picked from commit a71abdba32fec905a0a8cffb5e3b28e90575d76e)

GitOrigin-RevId: c7fe9b9a11c498e9a8bb3e62ed5a666c93d88315
2024-05-14 21:46:30 +00:00
Matthew Russotto
bff286cd71 SERVER-85799 rollback_recovery_commit_transaction_before_stable_timestamp should wait for system to stablize before disabling failpoint
(cherry picked from commit 96a249f90de9122a8e2633bac191218bacf820bd)

GitOrigin-RevId: 62390ceef144ee878f30282defd3b02c3a4316fd
2024-05-14 20:16:32 +00:00
Joseph Prince
b6f4701db4 SERVER-90054 Fix ConnectionPoolHistogramStats histogram check (#21736)
GitOrigin-RevId: 789e66f2268d3d3baa6126c33834696d6f54e859
2024-05-14 17:32:49 +00:00
Allison Easton
690f42ee83 SERVER-89939 Limit logs used for direct connection log ingestion to be once per hour (#21659)
(cherry picked from commit 38f5a87f7fe41cc67a0a332da1da6afaa3195cf5)

GitOrigin-RevId: 49dcc0bc6564d30c251624eb569def5b4b9309e6
2024-05-14 07:20:31 +00:00
Abdul Qadeer
baed401b42 SERVER-88978 Refresh coll placement info and wait for majority (#21517)
(cherry picked from commit cefaf3ae63503c751d30ff529f171e6b6df4518d)

GitOrigin-RevId: 4d0fa8ccb3c3295f9b4cda07c8c9f45fbc48ed23
2024-05-13 21:00:09 +00:00
Thomas Langston
bae0aa6ad5 SERVER-90329: twisted 24.3.0 report by github.com/imhunterand (#22017) (#22129)
GitOrigin-RevId: 049bc47d8e2a9bbb5ae541cd8c7efcac3031f1ae
2024-05-13 19:48:33 +00:00
Jordi Olivares Provencio
4da201a4d2 SERVER-86669 Always clear shard versioning metadata on secondaries whenever we create a collection (#21652)
SERVER-86669 Exclude secondaries_clear_filtering_metadata.js from multiversion tests without backports (#22104)

GitOrigin-RevId: 4051b57b8437206d3c082ae99dd0ad96c330d6ad
2024-05-13 16:14:40 +00:00
Chi-I Huang
7768e8785c SERVER-90297 Remove assertion on empty field match expression in rewriting change stream pipeline (#21990)
SERVER-90297 Remove assertion on empty field match expression in
rewriting change stream pipeline

rewriteMatchExpressionTree expects PathMatchExpression always has
non-empty field path. This causes a change stream pipeline with empty
field match expression to fail. This commit relaxes the restriction by
removing the assertion. The rewriter simply skips the rewrite upon
observing an empty field path from PathMatchExpression.

GitOrigin-RevId: a144612732e74dc120bb503a757d0ebdda12cfd7
2024-05-10 21:09:33 +00:00
Kruti Shah
be0af67dc0 SERVER-89859 Make move_chunk_deferred_lookup.js more robust to slower variants (#22035)
(cherry picked from commit 01d6734cd7ee560712600c7c2a9a19f3d3ed5097)

GitOrigin-RevId: 7a430affa09442502a72c98e7e96ad60a9a5e799
2024-05-10 15:29:19 +00:00
atesteve
9996070e16 SERVER-88694 Do not emit error logs for self-recovering scenarios in BalancerStatsRegistry (#22001)
(cherry picked from commit bbc9ad5fc268875b8b3cbaab34603196dc63b452)

GitOrigin-RevId: 945baa8452037383cc53a5d1d141eeab608c49e4
2024-05-10 14:41:35 +00:00
Steve McClure
490786533e SERVER-89904 Update Jepsen version for "jepsen-docker" tests (#21725)
(cherry picked from commit b600f5143c3e4584c48fc8661e90bbde62cc3ad3)

GitOrigin-RevId: 60768cadbbfd7ecd9f160eb3385229dc27f8aa6f
2024-05-09 13:13:51 +00:00
Carlos Alonso
fa967c1ce4 SERVER-89418 Improve CursorManager to hold multiple cursors per operation id (#21163) (#22056)
GitOrigin-RevId: 8644ba972de61e8f89a69720a359a2b73a622a2a
2024-05-09 12:16:50 +00:00
Ruoxin Xu
1fc0b2f2cd SERVER-89930 Validates the stage properly if 'partitionByFields' contains the densifying field (#21762)
(cherry picked from commit 39e2e41326cbe9ed3daf3f06e580bd9010e3f049)
(cherry picked from commit 23f69894f461042c220eaf9da15090b76787a7d5)

GitOrigin-RevId: c80bfa9cff702cc3f1b55ba554ea724b0d2bbfd4
2024-05-09 09:24:22 +00:00
Erwin Pe
6f4017b2b1 SERVER-90135 Ensure the Windows system CA stores are in a clean state at the start of ssl_linear tests (#21859)
(cherry picked from commit a0689af61fbbcc4cb439835e1032050c185fc091)

GitOrigin-RevId: b08596b9dcd405297534d5bb0804f6352e6a0f14
2024-05-09 02:54:34 +00:00
Gregory Noma
ae8362a36f SERVER-84531 Require collMod for direct mixed schema bucket writes (#18648)
(cherry picked from commit 9d4e4f2d3fbce6d49db056e5f85a590aef91c8b1)

GitOrigin-RevId: f78cb3cf1034fa3f4fb9420b5509f8f8a8813bf4
2024-05-08 21:03:40 +00:00
Vishnu Kaushik
e13d5df3bd SERVER-87087 Validate on clustered collections should handle non-long recordIds.
GitOrigin-RevId: 8a3f500220e382fe2cd1b0307f24aeef32cf55aa
2024-05-08 21:03:26 +00:00
Vishnu Kaushik
281af65315 SERVER-90069 run_restore.js and run_restore_unsharded.js shouldn't enforce fast count.
GitOrigin-RevId: 7a4bac0727f31931a2a1ddd4c93d63b666b3e79f
2024-05-08 20:16:46 +00:00
Gabriel Marks
05b71e2b68 SERVER-89954 Move setClusterParameter failpoint inside FixedFCVRegion (#21694)
GitOrigin-RevId: 8a62ba43092d3621c119bf6ecbfd1e8fca1652c1
2024-05-08 18:37:26 +00:00
wolfee
2ed9768b25 Revert "SERVER-78615: Update fallback_observer to update the dropped view from the catalog, instead of reconstructing all views"
This reverts commit eb12c11bc4c2584f010e7bceebd8f9d502777c09.

GitOrigin-RevId: e7648783ab1ea7d1d49f7065a46c3868ea18f40b
2024-05-08 17:55:54 +00:00
Dan Larkin-York
6c09779dca SERVER-87705 Fix race in InvalidTTLIndexFixer (#19773)
(cherry picked from commit 2e163a4a180f4e7f88cd86b33ebd1d248a6765a2)

GitOrigin-RevId: 1a0212dde78440f311f2f489be6117e7d8baad8f
2024-05-08 03:46:16 +00:00
kmznam
4935fbbf74 Revert "SERVER-88173: fixing BinData with $bitsAll/Any/Set/Clear expressions to be processed left to right (#20940)"
This reverts commit 7de812dd4469e2557b11dfe8895f30469a7164a2.

GitOrigin-RevId: 6745eb13fd541f09081544cf47028a52ba50ca4f
2024-05-08 02:54:02 +00:00
stevegrossmongodb
4291854efb SERVER-90264 Delete references to distsrc in evergreen config (#21959)
GitOrigin-RevId: f74c4d6fd3d6252574bb2faffd8c806ba76a1e22
2024-05-07 20:14:47 +00:00
Allison Easton
0bf1a628c5 SERVER-87059 Setting the cluster cardinality parameter may cause setFCV to fail on retry (#21597)
GitOrigin-RevId: 625ab4117f8b053ef608bbacaea24760fb7828cf
2024-05-07 19:25:12 +00:00
Drew Paroski
84dd6d8bc4 SERVER-85775 Make InListData sort and dedup its elements lazily
(cherry picked from commit 37af898a032e6d541b4231c9a410c595f4bdf2f9)
(cherry picked from commit 7906ea2848207fdad5edff1c63f8ecc6e4f52cf5)

GitOrigin-RevId: d2db8de386e185069223eef5d3b57150c5249368
2024-05-07 19:24:56 +00:00
Adityavardhan Agrawal
6fadae3553 SERVER-90170 Avoid using jsTestName in explain_skip.js (#21905)
(cherry picked from commit 89968d6577a46489d2ecf42f9f907c42ed5042c9)

GitOrigin-RevId: eb2c03c3c2ecc31e5e2c2cfeb6cce6e7620c3490
2024-05-07 18:09:31 +00:00
Kruti Shah
9fea945543 Revert "SERVER-89859 Make move_chunk_deferred_lookup.js more robust to slower variants (#21530)"
This reverts commit f6c31440d98655957593610dbbc83ead44f2b96a.

GitOrigin-RevId: 376d80b8fcb811a0086233112108585dbc127a7a
2024-05-07 14:15:06 +00:00
Allison Easton
a0b33b73dd SERVER-88264 Add an option to enable warnings for direct connections on single shard clusters (#21171)
(cherry picked from commit 5fa4777ae6bcfd92d321ca27ccfa0588e45bfb12)

GitOrigin-RevId: a4a35f2b1583e527573702f426e7242aab1b5fc6
2024-05-07 11:57:22 +00:00
romanskas
186ebf159e SERVER-90091 Robustify change stream split event tests against identical events (#21918)
When a sharded cluster generates "dropIndexes" events with identical
resume tokens, some of them might get skipped when the change stream is
resumed (see SERVER-90023). Therefore, we need to modify the current
tests until the original problem is solved.

GitOrigin-RevId: a919dcf3f873403484adb0c8cf928d29cbf973db
2024-05-07 10:49:26 +00:00
Tommaso Tocci
9467ddc001 SERVER-89943 Feature flag util must retry upon errors in suites with stepdowns and kill primary
GitOrigin-RevId: 45dbcf6d4f3818c2cf022109f3e9ebcc48629749
2024-05-07 09:31:44 +00:00
Erin Zhu
6b06c80795 SERVER-81454: Change Already Optimized for MakePipeline with Lookup
GitOrigin-RevId: 2d0ec162a7ddab84a790b54dabfe8027cceb4987
2024-05-06 17:31:50 +00:00
Gabriel Marks
4db113fa26 SERVER-89495 Disable test parameters even when no setParameters are specified (#21220)
GitOrigin-RevId: 1ae554dc452381fa0de28d9bc7b37ee25fc27e52
2024-05-06 16:41:09 +00:00
Mikhail Shchatko
1fe27776c3 SERVER-90187 Cleanup multiversion binaries before running resmoke tests (#21872)
GitOrigin-RevId: 01d863df83ff1e43337b2f2304581445968e5e03
2024-05-06 16:40:54 +00:00
Didier Nadeau
1d9d24c27b SERVER-89933 Remove shard split performance test (#21624) (#21823)
GitOrigin-RevId: 31c7c194494d0ce4eaa5cf4170b711e6679532a2
2024-05-03 15:45:18 +00:00
Mikhail Shchatko
94b352e832 SERVER-90090 Update Amazon 2 distros to the latest (#21811)
GitOrigin-RevId: a1bfdd25f2658d4c018511774a766e5506389a2b
2024-05-03 14:40:49 +00:00
julianedwards
94a03bcd3b SERVER-77561: configurable resmoke logger and buffered file handler for resmoke
GitOrigin-RevId: 9f359f48df472632424de916c5729236d1132ba8
2024-05-03 08:01:37 +00:00
julianedwards
0f2491b35b SERVER-77559, SERVER-77560: Implement Evergreen file system log handler for resmoke and update resmoke test results
GitOrigin-RevId: 4b950d4f333755bcb6fbe43636348a14675a0b19
2024-05-03 06:39:59 +00:00
Misha Tyulenev
1158db10d4 SERVER-82764 incorporate into planningTime time from multiplanner tri… (#18005)
GitOrigin-RevId: c9244fb68610d22ba337e18556c91c3b593c2552
2024-05-02 23:33:51 +00:00
Kruti Shah
0b13b6c7ab SERVER-89859 Make move_chunk_deferred_lookup.js more robust to slower variants (#21530)
(cherry picked from commit 0d31578474da5f367b4866475764098091d2e03f)

GitOrigin-RevId: f6c31440d98655957593610dbbc83ead44f2b96a
2024-05-02 22:55:00 +00:00
Jason Chan
14f77d00c3 SERVER-89873 Use printAllThreadsStacksBlocking() during execution control ticket stall (#21575)
(cherry picked from commit 76caa06e90d563527fbd108b5f85d6ae4a3413d0)

GitOrigin-RevId: 12ce7d7ce87bbb8d671896115c07fc8a921c0028
2024-05-02 22:00:35 +00:00
Adityavardhan Agrawal
8d55323e8b SERVER-90101 Add explain_skip to backports_required_for_multiversion
GitOrigin-RevId: df46ec6d3ddf3e2f5e2a5405dcedf78c6ae8a098
2024-05-02 22:00:21 +00:00
Arun Banala
3d35f06fb5 SERVER-88072 Fix time-series getNextBson() if the computed value is missing
(cherry picked from commit 29e3698c7cfbd2b7a641a1ae9bcfea24d99693c6)

GitOrigin-RevId: c945ac83674700379ab4e2178343351091b30cd8
2024-05-02 04:09:20 +00:00
Evelyn Wu
256da7bb18 SERVER-30832 Ignore dbCheck on rollback and startup recovery (#20290)
(cherry picked from commit d891fa5858)

GitOrigin-RevId: aaad22d588c0d9b11f3c0cd1d156cdc473b8a91e
2024-05-01 21:14:31 +00:00
Matthew Russotto
109dc40a5a SERVER-89618 Must disable validation when reconstructing prepared tra… (#21350)
(cherry picked from commit 0d49e10889886c356f128e3d18b28489948b37c1)

GitOrigin-RevId: 19ffd73257810d3e9fcc2ef9c723eedf4528048b
2024-05-01 20:14:53 +00:00
Samy Lanka
045fbe38b3 SERVER-86904 Don't use force=true when setting oldestTimestamp during oplog application phase of initial sync (#19233)
(cherry picked from commit b29335c9527c81a51eb345f0f5a03d539e674a61)

GitOrigin-RevId: 9673a202e1c05e3a0b8aaa9ad28abd54d3a3f9ee
2024-05-01 19:26:46 +00:00
HanaPearlman
dd14ffadf7 SERVER-90013: Do not use jsTestName in command_let_variables_expressions.js (#21686)
GitOrigin-RevId: be8f410d0ccbd1416b6e70a43b9fe2dd82cfbc01
2024-05-01 12:53:37 +00:00
Thomas Langston
f279685b53 SERVER-89567: Ignore distro if no home dir created (#21262)
GitOrigin-RevId: 3eada878eedd54a8c4b2564f44d358a75bced1c1
2024-05-01 03:23:13 +00:00
erinzhu001
ea6788e35a SERVER-90004: Only check for $_internalSchema on parsing errors (#21635)
GitOrigin-RevId: 84f5ece33eecdddae8650dc00faa6058dc120544
2024-05-01 00:15:42 +00:00
Adityavardhan Agrawal
b91b172aba SERVER-89936 Exclude latch analyzer tests from trySbeEngine (#21606)
(cherry picked from commit 1d2a2409a01f3b540ca66ca4ece4cb7c09ba2892)

GitOrigin-RevId: 11187e53da3d17ca0acc1669541b61cab9a95028
2024-04-30 20:19:53 +00:00
Huayu Ouyang
0958a46533 SERVER-90012 Fix dbcheck_skip_applying_batch_on_secondary_parameter for multiversion on backports
GitOrigin-RevId: f12f82f0cdcf68855adb60287381378166a95a29
2024-04-30 20:19:36 +00:00
Trevor
1f2aa7702b SERVER-85721 Point evergreen task log lobster links to Parsley (#18804)
(cherry picked from commit 74b1ebe084ebbabb72a7e0d4659a40a99796716a)

GitOrigin-RevId: 61d736cef0881a9e454588e433a023011ddb7770
2024-04-30 20:19:23 +00:00
SimonEismann
55c0a9add8 SERVER-89929 7.3 Make evergreen timeouts configurable on the CLI for sys-perf (#21654)
GitOrigin-RevId: 2ed4d1b7b442880113593013034a2948d9eb38c2
2024-04-30 18:59:09 +00:00
Steve McClure
e92f5ebf6b SERVER-89623 clone to tags instead of moving branches (#21292)
GitOrigin-RevId: fffb3583ada60a572c06413022512a1df8a5978a
2024-04-30 18:58:54 +00:00
Tommaso Tocci
a636aaad58 SERVER-89992 Allow renaming a bucket collection without timeseries options in local catalog
GitOrigin-RevId: c1c474574303694c1753b44f3c2a91ad89b11afd
2024-04-30 17:59:09 +00:00
adriangzz
40e4762042 SERVER-89454 Disable ocsp on Debian variants (#21577)
GitOrigin-RevId: b5822e692ae3ef1a3702528481bd2397ac04a8ea
2024-04-30 17:00:46 +00:00
Jordi Olivares Provencio
786590e7d1 SERVER-89893 Use fixed executor in _flushReshardingStateChange command (#21547)
GitOrigin-RevId: 6aa2ceabfbe220e6ceeb4eef3ae0443d44782f43
2024-04-30 15:08:06 +00:00
seanzimm
ad8ea73d48 SERVER-85446: Add retry on network error to config fetch in multiversionconstants.py (#18194)
GitOrigin-RevId: 662ef6002a5818a0fbb9cb23d45130d644a5a85b
2024-04-30 15:07:50 +00:00
Jason Zhang
abd444bc1e SERVER-88068 Exclude hashed_index_with_arrays.js from fcv_upgrade_downgrade suite (#20043)
GitOrigin-RevId: 80b359855b04d0faec0f1aa943c17f70959fe0c6
(cherry picked from commit 74fadeb132)
2024-04-30 14:22:00 +00:00
Henri Nikku
9874f214d6 SERVER-89831 Add extra logging to PlanCacheBase::getNewEntryState (#21519)
(cherry picked from commit 4571a07405d10da1c6b7376216b6bb69bbd23605)

GitOrigin-RevId: b2691ca18a2b0f3a4bca359d344d8e6248855c7c
2024-04-30 11:58:26 +00:00
Tommaso Tocci
afeb8d6490 SERVER-89100 Forbid rename on main timeseries namepsace in sharded clusters
GitOrigin-RevId: bf0ba96224f0db9cbed5de1b8594a87e0d29de15
2024-04-30 10:08:58 +00:00
naama-bareket
9c84b4e28c SERVER-88656: Do not log errors for CommandOnShardedViewNotSupportedOnMongod error code (#21108)
(cherry picked from commit 5bef4c4d5d8944b0de00fa4d900282cfdd115ec0)

GitOrigin-RevId: 97c5a747a4d6ba2fde42d140c1ba1823319470ea
2024-04-30 03:39:08 +00:00
Alberto Massari
7c36c55f95 SERVER-88331 Disable processing of numeric paths in SBE (#20308)
GitOrigin-RevId: 92baa7e59775b2fc92d34065b2fcbe1062e8acc0
2024-04-29 23:03:39 +00:00
Jiawei Yang
b4299fbdeb SERVER-80519 Turn featureFlagReshardingImprovements on in unittests (#18407)
GitOrigin-RevId: b5a6bbee088a98fdf57a5961dfc66f14cce750ee
2024-04-29 22:18:33 +00:00
huayu-ouyang
fa32013f38 SERVER-88885 Add a way to stop applying a dbcheck batch on secondary (#21088)
(cherry picked from commit e2c1ad8675282710a27d854d19773710fd8d8b5e)
(cherry picked from commit a0f7791efb3e7517bfa530a462d75e534891a235)

GitOrigin-RevId: 1c7c0230aff4f61babc5f0a77b294688ba3aa7e4
2024-04-29 18:15:08 +00:00
Silvia Surroca
1c68077512 SERVER-88548 checkShardingIndex command must throw InvalidOptions when no suitable index is found (#21544)
GitOrigin-RevId: 0bcfbf194ace4c3740405dca3f267adfd9f4d79c
2024-04-29 17:38:40 +00:00
Ali Mir
85bb10be21 SERVER-84628 Only log startup warning about persisted CWRWC defaults for shard servers (#18421)
(cherry picked from commit 58d45fe39687e4b8a82c6b7d6abe1c3da17d1f3c)

GitOrigin-RevId: 612c6bb6b06aaa623b07cb9be9753d40b37db681
2024-04-27 00:31:26 +00:00
Matthew Russotto
556993aab1 SERVER-87563 Failure to parse oplog entries should be less disruptive
(cherry picked from commit a119621e681ff7053e1247f344bf87409c7f7c46)

GitOrigin-RevId: 7b82d360f5526f135c2be1f8fea3a4bec99bf372
2024-04-26 17:44:16 +00:00
Peter Volk
ee520ed51d SERVER-88098 Move notablescan.js to no_passthrough suite (#21443)
GitOrigin-RevId: fb4a267f77049197b464ec3df11aebe761e21a10
2024-04-26 14:52:56 +00:00
Alexander Ignatyev
9fd383a64c SERVER-89854 Do not require parameterization for regex expressions (#21516)
GitOrigin-RevId: 84ed272c218f4c87e8f6b1e23b2106c67948a935
2024-04-26 12:21:28 +00:00
Lynne Wang
495e1c204a SERVER-86945 Make $jsonSchema with $field in properties reparseable (#21365)
GitOrigin-RevId: 2420f09ec2a66348db13c8d7cdbaabe2ab2761eb
2024-04-25 21:21:15 +00:00
Yuhong Zhang
3af602934e SERVER-86667 Treat readConcern available query on view from router correctly (#19595)
(cherry picked from commit 7a7e43552271140ee03eda5fa8995c5d3f3a5f1e)

GitOrigin-RevId: f84420ce97b0588762b7fb03111c54126d49057d
2024-04-25 20:36:39 +00:00
adriangzz
36ee316d10 SERVER-89478 Use element_to_be_clickable instead of presence_of_element_located (#21369)
(cherry picked from commit 5129086f5efb756fb3d1aef5c1015ea85e8180cf)

GitOrigin-RevId: 5fc68af45b6096b0bb7d7945b8324d713ed97a80
2024-04-25 19:19:13 +00:00
Ted Tuckman
5cefd2eff1 SERVER-89566 Pass originalSpec in DocumentSourceVectorSearch clone
(cherry-picked from commit 7016738d32d3540a3d30198567fef8ac6f2de365)

GitOrigin-RevId: 46f5a46c90e4bdf7e58ee4af1d9f3a0ca8a7adc2
2024-04-25 18:34:22 +00:00
Samy Lanka
9580c00ab1 SERVER-78556 change default value of internalInsertMaxBatchSize to 64 (#19169)
(cherry picked from commit 06cc1329db0248823f12e3782b74b8d148034bc9)

SERVER-88111 random_DDL_CRUD_operations.js bulk insert should perform max internalInsertMaxBatchSize inserts (#20264)

(cherry picked from commit 959538ddbb9c69e1b6e51c8fd7af1b71a545e0b7)

GitOrigin-RevId: 99965c3be818ea2c5537b05953e081d1e9dd204d
2024-04-25 17:47:57 +00:00
Wenqin Ye
dd842483bc SERVER-89646 Add all Network Error Code Strings to List of Strings isNetworkError() Looks For In Exception Message
GitOrigin-RevId: 01c2a52c10c6c6ee993aa053a31a2ed5494d841f
2024-04-25 16:32:07 +00:00
Allison Easton
9960144ff2 SERVER-88263 Move direct connection warnings to the collection acquisition (and AutoGetCollection) (#20775)
(cherry picked from commit e12af22f19c01f3c129db5e75ca9cb0e308624e6)

GitOrigin-RevId: fcaba356f53f87d2a761e5838131492631eba431
2024-04-25 15:45:54 +00:00
Adam Farkas
a209dcd842 SERVER-84761 Fix MigrationSourceManager's possibly stale placement info (#20664)
GitOrigin-RevId: c3783f0722d6cba55c80fd83c1586e771f2a212d
2024-04-25 13:50:01 +00:00
Paolo Polato
d8c5327b2d SERVER-89443 Rewrite insert_with_data_size_aware_balancing.js as a ShardingTest (#21388)
(cherry picked from commit dc4d15bbac17031790de78255746d80ee34ae74e)

GitOrigin-RevId: a57aa6cc07f621322f0639bde92a834478a58f45
2024-04-25 13:00:40 +00:00
Mikhail Shchatko
a551651ab2 SERVER-89767 Remove redundant and incorrect suite names from multiversion tasks
GitOrigin-RevId: 135af50bd6d2b4472864d579b8f37f6ed21c7449
2024-04-25 12:13:12 +00:00
ppolato
f34af54a57 SERVER-88833 Fix mongos reply payload for Fire And Forget batch/bulk writes (#20819)
(cherry picked from commit c82df80e37b00511efa654d78639c73567e22fa3)
(cherry picked from commit 38daba8f2c57f3cb9bfa0916e24c092db9388363)

GitOrigin-RevId: 98aaee143f17e6876d53edd8f5855643f4484b48
2024-04-25 09:35:05 +00:00
ppolato
a96c2210b6 SERVER-83193 Remove write concern from BatchedCommandRequest (#19583)
GitOrigin-RevId: 9b16510831c5c7e5f43071778e13976949ef12cd
(cherry picked from commit 70b203bcb1)
2024-04-25 09:34:50 +00:00
Drew Paroski
227f76e0cf SERVER-89034 Always preserve 0-valued timestamps when migrating documents, add tests
(cherry picked from commit 67bb49606db89b40e3ff4d51b0a784b413b3810a)
(cherry picked from commit cb072f45bb20424081f19dc5abacdce7410b03dd)

GitOrigin-RevId: 6a00dcd8b71019f6879bab991cbe004873ec5023
2024-04-24 22:03:24 +00:00
Trevor Guidry
223e3c24f8 SERVER-89752 Make logkeeper buildIDs stay unique when branching (#21432)
(cherry picked from commit 558637538525610e117e35031a3a23dd3cf8db86)

GitOrigin-RevId: a5bb52e2c64ca27b7bab49cadb6f628cf91e8d50
2024-04-24 21:16:28 +00:00
Charlie Swanson
4c232bb3f5 SERVER-89611 Fix $group with empty object expression
GitOrigin-RevId: cb58a79ea634ff332b6b6f3c145571db23a09c95
2024-04-24 18:44:56 +00:00
Henri Nikku
844f403dca SERVER-89474 Properly validate sortBy when parsing $setWindowFields (#21213)
(cherry picked from commit 173283915c6fd370cd60498b175cf26930d18070)

GitOrigin-RevId: 823d1fa0df3e8594ed5858e9d3e885d10836b31c
2024-04-24 12:31:49 +00:00
Mikhail Shchatko
fe856556e2 SERVER-89653 Install db-contrib-tool with --no-cache-dir argument (#21353)
GitOrigin-RevId: 2070eb12dd9c3a967189fc440c2766bdf392524b
2024-04-24 11:41:29 +00:00
HanaPearlman
e9950adf3c SERVER-89717: Allow command_let_variables_expressions.js to run in multiversion tests with 7.0 (#21409)
GitOrigin-RevId: 13b983633d1a5814d6ebeaf33093e72564dc2041
2024-04-24 00:34:52 +00:00
HanaPearlman
7753510298 SERVER-89268: Serialize 'let' variables by wrapping in $literal, serializing missing 'let' variables with $$REMOVE (#21227)
SERVER-89268: Serialize 'let' variables by wrapping in $literal,
serializing missing 'let' variables with $$REMOVE

When serializing values, for example to populate the 'let' parameter of
a command to be sent over the wire, we need to be careful. First,
missing values should be serialized as "$$REMOVE", otherwise they might
be incorrectly omitted or serialized as empty objects ({}). We should
wrap other kinds of values in $literal to avoid a scenario like the
following: suppose we had a user-defined 'let' specified as {let: {a:
{$literal: "$notAFieldName"}}}. On mongos, this will be evaluated to the
string "$notAFieldName". When we serialize it again for the shard
commands, it must appear as {$literal: "$notAFieldName"}, not simply
"$notAFieldName", since the latter will be treated as a field name by
mongods.
GitOrigin-RevId: 495fdeb1d286a8f8c462ddd642888c21094f6e51
2024-04-24 00:34:37 +00:00
Joseph Prince
3bdfc876fd SERVER-89641 Increase scoped_db_connection_test histogram window (#21324)
GitOrigin-RevId: c3d6408e874741607f0c86144444cd44374b20b6
2024-04-23 23:48:16 +00:00
Mariano Shaar
00c49b4d9e SERVER-89690 Add diagnostic log messages to query_stats_regex.js (#21364)
GitOrigin-RevId: 549489a0d9f48020f5af59f7c035e5c0b99256c2
2024-04-23 22:40:28 +00:00
Alex Li
597d58f39d SERVER-89467 ftdc_mirrored_reads.js should wait for metrics to converge before proceeding (#21178)
GitOrigin-RevId: 39d93a683878b73444fcbcb6299ba3f68c642e32
2024-04-23 17:39:45 +00:00
Evelyn Wu
b0bb274351 SERVER-87343 Add awaitReplication() before stepping up secondary in range_deletions_has_index.js (#19541)
(cherry picked from commit b8024dc98e668b5486e2bd4d137ae3caac63d8b2)

GitOrigin-RevId: c3db97c084d6e8981a03139a2665bf5a9bd8c371
2024-04-23 16:22:16 +00:00
ben-gawel
1982e9e51e SERVER-89163 Ensure majority before critical section of chunk migration (#21311)
(cherry picked from commit 67673c94d3109e4aa359dda9dc93f1ce5fdfc242)

GitOrigin-RevId: 3c59ef4a7e5b4e39c93f9cd230a98add65ffe7e8
2024-04-23 15:30:48 +00:00
Erin McNulty
2a45794459 SERVER-87623 Make benchmark_repetions=1 for sanitizer builds (#19719)
(cherry picked from commit befa6aa40153b8f00db8c12989e15605de34b7d6)

GitOrigin-RevId: 18a10ea5e04b4faf2625dc574b1a71b0da09861a
2024-04-23 15:30:32 +00:00
Erin McNulty
634c49f234 SERVER-87621 Make session_workflow_bm only iterate once under sanitizer builds (#19726)
(cherry picked from commit 6e7d6c4d18f8e42d671515dc88cee6fa1b5c91ad)

GitOrigin-RevId: 8a7c0d25e478c989d2f2f43f7c7e11d24c3179f5
2024-04-23 15:30:18 +00:00
adriangzz
bacddef2f9 SERVER-86482 Hold authorization cache generation mutex for duration of invalidation (#20632)
(cherry picked from commit d1ee2fa9ecb41fac074a093fafd375f0890516d1)

GitOrigin-RevId: 0e8d7113cbf9e61fbad70d88af2ddf0eae116a72
2024-04-23 14:44:37 +00:00
Antonio Fuschetto
ad7907a1e4 SERVER-89592 replication_consistency_markers_impl_bm should skip direct shard operation checks (#21291)
GitOrigin-RevId: eb6403eb2ceb5753e17e685ade269232548aaf6b
2024-04-23 13:42:22 +00:00
Serhii Lysenko
d868cf9cf5 Revert "SERVER-53974 Generate unique field name for partitionBy expression" (#21339)
GitOrigin-RevId: fcf7fd750edaac843f90e03049562e7abdafa2a9
2024-04-22 16:18:51 +00:00
Drew Paroski
006c8b210a SERVER-86474 Always preserve 0-valued timestamps when replaying updates from the oplog
(cherry picked from commit 4c337d176a932cb7978a792bd2c260689019572f)

GitOrigin-RevId: 62f3230d1d884bcbc091de7154f60af8b43b68f5
2024-04-19 18:38:51 +00:00
Adityavardhan Agrawal
6a00f6ac3f SERVER-88949 Fix skipAmount in explain (#21199)
(cherry picked from commit 78453425ac98a10d59947385f001be0a89fbee2d)

GitOrigin-RevId: b4efbec26f9e9824750308eed5f48ec450d65606
2024-04-19 17:51:58 +00:00
Gregory Noma
a7af9f1da6 SERVER-86648 Sync sorter file on shutdown (#20979)
(cherry picked from commit 19ee8e5d2d505ff5a57f7f3e91820d2c7bb8f272)

GitOrigin-RevId: 8340fd5698fb5faebbe087501f89c83fc675d577
2024-04-19 15:59:23 +00:00
Mikhail Shchatko
d273663ba5 SERVER-89554 Fix evergreen/compiled_binaries_get.sh script (#21254)
GitOrigin-RevId: a0c9557fe56706905286c67ceaff4a1b8e8a1ce8
2024-04-19 14:16:01 +00:00
ppolato
fcaa4dc90b SERVER-89250 Use TestData to check whether a continuous CSRS stepdown suite is in execution (#21023)
(cherry picked from commit f39d7ec24a70393102da453cd2c6ce5fc5a4cd5e)

GitOrigin-RevId: c6907652b6230b938b4387e57941632ab1ebb4b8
2024-04-19 09:05:24 +00:00
Marcos Grillo
32120c1b55 SERVER-89134 Remove multi document writes targeted without shard key in test that assumes that they should be atomic (#21135)
(cherry picked from commit 1a647212aefee75af9eb21f998c7febfcfe654ae)
(cherry picked from commit b8276e31439d44c991c7d8cad4964e49a99ee676)

GitOrigin-RevId: 38f8ed357ad951f652a9fabc5330b89e6ce6871b
2024-04-18 14:53:27 +00:00
nandinibhartiyaMDB
ba0c19dc1d SERVER-84463: Replace withOneStaleConfigRetry with shardVersionRetry(#20691) (#21236)
GitOrigin-RevId: 4d9ae40b5587e2c7274e49c521aacb1a87ae15ea
2024-04-17 21:52:29 +00:00
Mariano Shaar
a83f778c4a SERVER-87634 Add explain to the query stats agg key and collect explain queries on mongos (#20553)
GitOrigin-RevId: da03019df5fe32eac13703ef6e6c464e508ba9d7
2024-04-17 16:49:38 +00:00
samontea
b54bcc6632 SERVER-88013 Bump up time limits for wildcard, timeseries, and multiversion fuzzers on RHEL asan
GitOrigin-RevId: ca54dc2aea6afe3076155c5e68436920ea5e1ca8
2024-04-17 16:49:25 +00:00
Erin Zhu
b1819c98ae SERVER-87032 Collect query stats for change streams
GitOrigin-RevId: e47eba6540df96b4d52472ac57e6743c710bd737
2024-04-17 14:26:53 +00:00
Dominic
d1a2229f7e SERVER-87348: removed latch_analyzer.js from multi client / concurrency tests (#19510) (#21019)
GitOrigin-RevId: e10877b62ba9d9b4ac919791506030aa80ecc5c9
2024-04-16 23:13:55 +00:00
Justin Seyster
a7bd1c36d7 SERVER-87379 Cache the value of CanonicalQuery::toStringShort in PrepareExecutionHelper
GitOrigin-RevId: 3d7b48ddafdd328cb9641427d9f5d10c672738c6
2024-04-16 21:21:07 +00:00
Antonio Fuschetto
addcee0cdc SERVER-89414 Harden shard removal in a store_historical_placement_data.js test teardown (#21129)
GitOrigin-RevId: a5f64e2e2147f5a8300542bee986ce6b840d65d0
2024-04-16 15:02:18 +00:00
Mikhail Shchatko
fd2eb97079 SERVER-89253 Make re-using compiled binaries in scons compile script more resilient (#21027)
GitOrigin-RevId: 1427f0ea2be2d80a2a5879401c52dfa133ebbea3
2024-04-16 12:22:31 +00:00
Mikhail Shchatko
f2b39490cc SERVER-88942 Update db-contrib-tool version that includes fix for downloading old binaries (#20737)
GitOrigin-RevId: 0d9e1204cbb23dc46aff01aa2d37c7a68e900969
2024-04-16 12:22:17 +00:00
Erin Liang
0316818a35 SERVER-87537 Make internalSearchMongotRemoteSpec not strict (#20681)
(cherry picked from commit 88142be834f3aa8f73348f832fd93b6b3240565f)

GitOrigin-RevId: e14583dc1982c0a4d279ba688e0536f665c011df
2024-04-15 21:29:02 +00:00
adriangzz
166d0451c0 SERVER-86779 Fix case were azure generates 2 different html (#19704)
GitOrigin-RevId: 5c0806cc04062e8063db820ae25fcf40c2e28184
2024-04-15 20:43:52 +00:00
Joseph Prince
9916133012 Revert "SERVER-87564 Make AsioReactor drain all work (#21096)" (#21141)
GitOrigin-RevId: 2c442055e4dd32b8526f8ddc8911ed3a286d38c7
2024-04-15 19:27:04 +00:00
Will Buerger
beeebadd21 SERVER-88165: Only generate search meta pipeline when it will be used
GitOrigin-RevId: faf2bc5ab236be20d8cb18f2490d3f77ef160d15
2024-04-15 18:34:29 +00:00
Sophia Tan
403b3f1abc SERVER-89164 upgrade_to_use_multitenancy_support.js shouldn't send requests until the node is in SECONDARY state
GitOrigin-RevId: 963ed168912bb7231b9af7dc9e3d36b5420b0473
2024-04-15 17:48:12 +00:00
Wenqin Ye
c6e2748433 SERVER-88063 Add RetryableWriteError label when write operation fails with StaleConfig and is direct to shard
GitOrigin-RevId: 925e74ecccc99d999ab40ad430a1001fdc0e874b
2024-04-15 16:59:34 +00:00
Dziana Hurynovich
bb7df09249 Revert "SERVER-88165: Only generate search meta pipeline when it will be used"
This reverts commit 574bafd6b686ff2f05430d6d7e483e26d35bb315.

GitOrigin-RevId: 4754d6d3e60ba0b6bd3903f0a2f8cec519a8fd11
2024-04-15 14:06:52 +00:00
Paolo Polato
4713e0f2b4 SERVER-89402 Do not execute insert_with_data_size_aware_balancing.js in suite killing/terminating the CSRS primary (#21119)
(cherry picked from commit fc183b5c57cdeae9f704e4356ed347babb372f0b)
(cherry picked from commit 8c26620a8b5274c01f50bdd0955968d8b3ad649a)

GitOrigin-RevId: 4fcd9ccc1152509e00be535c680c89c470c25eba
2024-04-15 13:13:11 +00:00
Joseph Prince
741d5193b6 SERVER-87564 Make AsioReactor drain all work (#21096)
GitOrigin-RevId: 5a173d74c78151c8c6b5fb7dce379e8d28ac6e96
2024-04-13 01:09:57 +00:00
Joseph Prince
fb6eef4630 SERVER-87930 Synchronize access to CaptureLogs logs (#20907)
GitOrigin-RevId: 97dd524b6756db137cbc31eb1cda13f5a80baa8e
2024-04-13 00:18:58 +00:00
James Bronsted
ed84e583fc SERVER-88149 ensure unfulfilled commands are waited on during NITL shutdown (#20745)
(cherry picked from commit 66dfb82d97ce926eb76b9c9ab80e118c1aaef60d)

GitOrigin-RevId: aea267fe0852aa0f8273efb148e596f0bec21d30
2024-04-12 23:14:50 +00:00
Suganthi Mani
d14888565f SERVER-88980 TenantMigrationDonorService aborts migration before waiting for forget migration upon all recipient errors. (#21041)
(cherry picked from commit 5335c6c826fae82d9a3bf714d26ac5a69938d0ac)

GitOrigin-RevId: 55140ecb362df821ff44d1630afaaeb450299daf
2024-04-12 22:20:11 +00:00
Will Buerger
b5615fd04b SERVER-88165: Only generate search meta pipeline when it will be used
GitOrigin-RevId: 574bafd6b686ff2f05430d6d7e483e26d35bb315
2024-04-12 21:35:47 +00:00
Jordi Olivares Provencio
44812cb038 SERVER-79049 Correctly handle UUID mismatch errors in the router (#18959)
GitOrigin-RevId: cd43c2f0de45f5daa5eb97c32989ae53668ce0ce
2024-04-12 15:52:41 +00:00
Allison Easton
606dce4d46 SERVER-77073 Direct Shard operations shouldn't be allowed anymore (8.0 behavior) (#20956)
(cherry picked from commit eb4147b2d40545ce1ca879a8078437a244f32053)

GitOrigin-RevId: e4c96aaa75b33195efce633257731fbf44eeb617
2024-04-12 15:07:44 +00:00
Allison Easton
a03a32c789 SERVER-86796 Move direct connection checks into the collection acquisition (and autoGetCollection) (#20149)
(cherry picked from commit b2360c084aa5282201c252f2cc1153591022dcb2)

GitOrigin-RevId: 04ba7cfb0c352bcf471bca779b11e3e0fbbaafb0
2024-04-12 13:59:47 +00:00
Evelyn Wu
5c85367f02 SERVER-80340 Handle and test dbCheck during initial sync (#19886)
(cherry picked from commit 0e6ef693ed)

GitOrigin-RevId: 44bdb71ea7207ccb7fd2636b969888ebb5836752
2024-04-11 23:20:11 +00:00
Mariano Shaar
9f1b4bdf5f SERVER-86654: Fix $regex $options re-parsing
GitOrigin-RevId: 8262b8da372aedf6ce8a22479e4b62c4ee80e40a
2024-04-11 23:19:58 +00:00
Damian Wasilewicz
aa5003e120 SERVER-88017: Resolve lock-order-inversion TSAN error in TimestampKVEngineTest (#20044)
(cherry picked from commit a4ce61ec7847d90f02c3d015cbdb26c1b8dae71b)

GitOrigin-RevId: 375239ad0b61c1a3b7f9dbb92ecab55e63b25057
2024-04-11 22:31:56 +00:00
Damian Wasilewicz
864d886e60 SERVER-83370: PrepareUnique:true for time-series collections should error (#17981)
(cherry picked from commit 208110eafeaee5a396c81c2c406415e4aa5265ad)

GitOrigin-RevId: c9605ab507e249b2aa649d74e780f53c5ab60e5c
2024-04-11 22:31:43 +00:00
nandinibhartiyaMDB
6240da4ab1 SERVER-89178: Add tag to reshard_collection_resharding_improvements_recovery.js (#21068)
GitOrigin-RevId: 95f95e221d01958a3f45913e2c6b23279f6374d5
2024-04-11 22:31:30 +00:00
Kaitlin Mahar
abc46b5a63 SERVER-88864 Make nodes_eventually_sync_from_closer_data_center.js more robust to transient slow heartbeats (#20677)
(cherry picked from commit 9441294d183b9038fb8c37c9cd296fbe538698dc)

GitOrigin-RevId: 7f6fecb8a4471d64cfffa93d899dc8c88ce6600e
2024-04-11 21:42:14 +00:00
Janna Golden
6e6137e707 SERVER-88651 Ensure resharding metrics object still exists when reporting currentOp info (#20924)
(cherry picked from commit d5f8c31907c622f2ab8b864ec1b21cd2523ecd1c)

GitOrigin-RevId: eb43e52880d1d5b15fb215bf15c581a7626ca44c
2024-04-11 20:57:20 +00:00
Gavin Peters
bd39deb1f3 SERVER-82349 Do not crash with unspecified uuid in oplog (#19210)
GitOrigin-RevId: 2bf3c918259235bf6e51a8e93603f75c417f2fc4
2024-04-11 19:02:22 +00:00
Brett Nawrocki
afd5489f43 SERVER-86505 Write w/o shard key test allows SnapshotUnavailable
GitOrigin-RevId: 427584ba97aaaec0455df6c0f8afa793d51ce1b3
(cherry picked from commit fff1bd71c0)
2024-04-11 19:02:08 +00:00
David Percy
98f98b91f2 SERVER-89235 Add a missing tag for new jstest using explain()
This test was failing in sharded_retryable_writes_downgrade* suites
because explain() only supports read concern local.

I think this wasn't caught when the test was first added because these
suites ("downgrade") exclude tests from
'etc/backports_required_for_multiversion_tests.yml' until they are
backported.

GitOrigin-RevId: 9d2eb5cb4e22c5d9bc99e37b88768784bf33fbcd
2024-04-11 18:16:36 +00:00
Enrico Golfieri
5dfb61b172 SERVER-86798 blacklist validate_db_metadata_command.js from tenant migrations suite (#19526)
(cherry picked from commit e0bc86ed21b50ce3533147eb31c563084d1f7c7c)

GitOrigin-RevId: d5642e1475a3b192923f42fec3807b0d2d644fcf
2024-04-11 16:26:00 +00:00
roganamy
ef8f01722d SERVER-88706: Remove unused old compile logic from system_perf.yml (#21034)
GitOrigin-RevId: 74653436452034ef2b870937aea33326f213b7af
2024-04-11 16:25:44 +00:00
Ahmad Shah
592e93ed93 SERVER-88187 - V7.3 - Update perf tasks to use f_dsi_run_workload instead of f_run_dsi_workload (#20135)
GitOrigin-RevId: 15e83180c834a394db94afc619730f49d74a4e24
2024-04-11 14:51:50 +00:00
kmznam
b9e9236e68 SERVER-88173: fixing BinData with $bitsAll/Any/Set/Clear expressions to be processed left to right (#20940)
(cherry picked from commit 3e493701c295ddafb62b7f69560ee0f24ff06d2b)

GitOrigin-RevId: 7de812dd4469e2557b11dfe8895f30469a7164a2
2024-04-11 14:51:34 +00:00
Allison Easton
d8316d9597 SERVER-86790 featureFlagCheckForDirectShardOperations is enabled by default under different FCV values across different branches (#19803)
(cherry picked from commit 00c47a897bfef31b5c40567fbb8fe3756d1d7f67)

GitOrigin-RevId: c35a8caba9cf801d1df4322c74fbd26bf44f3798
2024-04-11 14:51:19 +00:00
Ted Tuckman
ef0cbdd39c SERVER-85751 Move $vectorSearch validation to mongot
SERVER-86495 Send original filter expression during $vectorSearch queries

GitOrigin-RevId: b698a77e09a6d4977599fe0fa474e1c684a6f015
2024-04-11 14:04:25 +00:00
John Daniels
0febe56b5d SERVER-85306,SERVER-85368: Update modules import to match other branc… (#20990)
GitOrigin-RevId: 233cd0e8d88c535763ec3109760df1bd12e8c055
2024-04-11 14:04:10 +00:00
John Daniels
b88efeda4e SERVER-88097: Add --release flag to sys-perf compiles (#20083)
GitOrigin-RevId: ee73569d9af8f510c546169e12a438081b15da4b
2024-04-11 14:03:55 +00:00
Brett Nawrocki
06590c13f0 SERVER-87158 Remove Bad Invariant from MultiUpdateCoordinator
GitOrigin-RevId: 515b5127f49447fd99a3ebcb7071ed064f2a62cc
2024-04-10 23:43:49 +00:00
Gavin Peters
f0798da4bb SERVER-83984 WiredTiger log messages go to info (#18914)
GitOrigin-RevId: 046d85826d920c8092001865dada60934e4ed3c2
2024-04-10 23:43:34 +00:00
Louis Williams
3a6fa48f71 SERVER-86365 Ticket stall detection should not be fatal in testing (#19558)
GitOrigin-RevId: d5e95f4a6c80af498f839c7e35478296c7665744
2024-04-10 23:43:20 +00:00
Louis Williams
7184c2b95c SERVER-86375 Make index_build_memory_tracking.js less strict (#19564)
GitOrigin-RevId: e9d07549ee6c7185078e47cbdedd9718aaf31a30
2024-04-10 22:54:28 +00:00
Joseph Prince
a5ae4dfb15 SERVER-86433 Clear the memory of asio::detail::sockaddr_un_type (#18849) (#19226)
GitOrigin-RevId: 26f3b8812f458d234061eb18a327ad0405c55723
2024-04-10 22:54:14 +00:00
Binh Vo
f453e65cc2 SERVER-88202: Fix possible integer overflow in BSON validation (#20226)
GitOrigin-RevId: c9a9d1f9fa5b407885779b68969704a32fb5b258
2024-04-10 21:42:40 +00:00
Joseph Prince
95d49f8e58 SERVER-87518 Disable THP on mongod and mongos in testing environments (#20244)
GitOrigin-RevId: 1b7a9e281462babc8cab294b512b13d444c49a88
2024-04-10 21:42:25 +00:00
Wei Hu
1f3e4e6a26 SERVER-89156 Reduce resmoke jobs for replica_sets_auth on enterprise-suse12-64 (#20947)
GitOrigin-RevId: 10a76dad00a86778f007a9b73a2bea89be963a1e
2024-04-10 21:31:47 +00:00
John Daniels
3dddbf4eac SERVER-88755: Add mongodb_setup_release to all Atlas variants. (#20810)
GitOrigin-RevId: ca469499eec1f0ccf35464cccaf173584214f496
2024-04-10 20:43:44 +00:00
Chi-I Huang
0913de9931 SERVER-85892 Fix incorrect output namespace in $merge spec (#19846)
SERVER-85892 Fix incorrect output namespace in $merge spec

During the pipeline validation, the original implementation passes in
the namespace 'pExpCtx->ns' to validate the pipeline in whenMatched.
However, this is incorrect as that the pipeline is operated on the
collection specified in 'into' rather than the db/collection the
top-level pipeline operates on. This bug is revealed when a command
operates on a collection-less pipeline (i.e. 'pExpCtx->ns' points to
$cmd.aggregate collection) when query stats enabled or under sharded
cluster.

This commit corrects the namespace for pipeline validation and adds
jstest to verify correctness under various environments.

GitOrigin-RevId: d061e83f3742300e9492bf0531de3cd7b7de0efc
2024-04-10 20:02:02 +00:00
roganamy
c290fc9e5d SERVER-87600: Delete older variants from system_perf.yml (#19692)
GitOrigin-RevId: 877097eaf7033269d38e49238aa4ef629879cc58
2024-04-10 20:01:47 +00:00
Binh Vo
98490763ef SERVER-85681: Fix for negative value being passed to BasicBufBuilder:… (#18357)
GitOrigin-RevId: f483c423cc1203f08d87842e94d50ef8d61a4ed8
2024-04-10 17:40:12 +00:00
Will Buerger
28600e8411 SERVER-86227: Disable exchange_producer.js from config_fuzzer suites (#18710)
GitOrigin-RevId: 7b066c0f33def99b9e4338e0425b6b8adc360f03
2024-04-10 17:02:55 +00:00
Adityavardhan Agrawal
bf973f16e1 SERVER-87616 Add trySbeEngine build variant (#19807)
(cherry picked from commit 02cd1cba65df1c47dc26b438ab728801575eccfd)

GitOrigin-RevId: 711198fadc66ffd4439ac2e7910539b69ef7cbb7
2024-04-10 17:02:39 +00:00
Robert Sander
453e84ab29 SERVER-86987 Ensure check_metadata_consistency.js use retryable writes when contacting config server (#20766)
(cherry picked from commit 73c70e50951908e2e5c6dc1c738fbca9553f0246)

GitOrigin-RevId: 98ec09427376adcb69ea7ab5edbf63808a1b55b7
2024-04-10 16:17:43 +00:00
roganamy
63b062b8ef SERVER-88706: Remove unused old compile logic from system_perf.yml (#20918)
GitOrigin-RevId: 279dbefaa00b2f4651601c78a032b51c54fa9374
2024-04-10 16:17:29 +00:00
Erwin Pe
b5475f3864 SERVER-86642 Update IDP selection process
(cherry picked from commit e23ea52dbcc1f99bd7d7e1bbedef73b8a0233186)

GitOrigin-RevId: 6d5f2d9def85634351e111ae99e1a1b9de2b4610
2024-04-10 14:53:53 +00:00
Yu Jin Kang Park
b6db60046c SERVER-83956 Remove mongod version check in balancer (#19330)
GitOrigin-RevId: fb715e0da3ff8fbd177808828adb55a1154557d9
2024-04-10 14:53:30 +00:00
SimonEismann
3233502b89 SERVER-89068 [7.3] Explicitly set exec_timeout and timeout_secs for the sys-perf project (#20968)
GitOrigin-RevId: 9c08834178fcc35b1715b3175c84802df1638a53
2024-04-10 14:53:15 +00:00
Yujin Kang Park
be6d499ada SERVER-72431 Make _configsvrCommitChunkSplit idempotent (#17998)
GitOrigin-RevId: 460e5e9e4c91224e33fc7862c9b9164294784fdf
2024-04-10 11:12:56 +00:00
Robert Sander
abdaf37597 SERVER-82571 Enhance robustness of insert_with_data_size_aware_balancing.js against slow variants (#20276)
(cherry picked from commit cac3bd84f4b44dbf58b0878a73657d37292a6c15)

GitOrigin-RevId: 51398c4c714d0847217a3f3c12b86d8d473cd92a
2024-04-10 09:30:27 +00:00
Binh Vo
bf2f07ec6d SERVER-86646: Fix decodeRecordIdStrAtEnd handling of unterminated size bytes (#18996)
GitOrigin-RevId: 00c75a8aaf1a884bb4a23d2f923b2f1f9b483e79
2024-04-09 22:47:27 +00:00
Erwin Pe
c4bc040b7f SERVER-86380 Allow for multiple IdP configurations with the same issuer but unique issuer-audience pair
(cherry picked from commit d77904169614384ce062218076e2d7b72be73104)

GitOrigin-RevId: 987d65a9e3ff4308f2fbc6afa0a8ffe03dd8e22e
2024-04-09 19:58:34 +00:00
Ali Mir
b193ae01c8 SERVER-88136 Fix arbiter_always_has_latest_fcv.js test to correctly test arbiter FCV behavior (#20108)
(cherry picked from commit 9884a11dc2401e62f8d7bb10f219f7e7d5534f36)

GitOrigin-RevId: 9683f5317f0ad150eefa39b6502c922486c92022
2024-04-09 19:58:18 +00:00
Gregory Noma
b41abd84f9 SERVER-86478 Distinguish empty and missing for bucket metadata (#19362)
(cherry picked from commit 4f3051ee15b358fe5f55894ade11b337cced07df)

GitOrigin-RevId: cc5916c42b5d36584c2c0fe2ac35e1d58932dadb
2024-04-09 19:37:46 +00:00
Gregory Noma
9ef16752b7 SERVER-86327 Check data type when updating time-series schema (#19350)
(cherry picked from commit 5488646b82d0862eaee9f61bffd55cdc6663970a)

GitOrigin-RevId: 5e89b61918894b6c0f7c93024e1b70e9e91988c1
2024-04-09 19:37:33 +00:00
Erin Zhu
9a5ccfaa7f SERVER-87987 Remove fields from computedMetaProjFields if they are not included in the project
GitOrigin-RevId: b715210c06bd4cae61f69e9b06e50942604dafd4
2024-04-09 18:18:43 +00:00
Sara Golemon
6c5229e1da SERVER-89067 Broaden match criteria for AuthorizationManager::invalidateUserByName()
(cherry picked from commit a218496adad5eb1d0ac222645f8d74bd1829715f)

GitOrigin-RevId: 78e19bf650717ce7e3c7f83e9d46345df86c11fa
2024-04-09 16:46:42 +00:00
adriangzz
a765cb433b SERVER-87306 Prevent accessing OCSP manager ptr during shutdown (#19593)
GitOrigin-RevId: 4f496ea768b4a838ddfdf2724c2a111cb954c519
2024-04-09 16:46:24 +00:00
Tommaso Tocci
e9de210b00 SERVER-86622 Resharding coordinator use possibly stale database info (#19095)
(cherry picked from commit 2e0996196802d214edd0c6149b2aaa30d5a1b6c9)

GitOrigin-RevId: 3c7bfb15b900b3e4093ea2c1939bc297e359d96f
2024-04-09 16:46:07 +00:00
Ruoxin Xu
de1c31bc76 SERVER-81807 Disable optimizing projection if the query can be run with SBE and there exists user-defined let variable (#18150)
(cherry picked from commit 4d64fa2ac92cc7e6b1fd7924f0f9c66155d99f23)

GitOrigin-RevId: 49131537196906ebd9afbe09d2fc7df543ec1feb
2024-04-09 16:01:04 +00:00
wolfee
b82ba8e663 SERVER-88650 Fix deadlock in VectorClockMongoD during shutdown (#20495)
GitOrigin-RevId: 0b61b21cd8f82fad52b8fa56b8a72fbf47820d7a
2024-04-09 15:34:44 +00:00
James Wahlin
a607ecc996 SERVER-86033 Remove test assumption on even shard distribution (#18601)
(cherry picked from commit 4131ddaaf4092542b5aa8eca8f5f0e1c8d8dc70d)

GitOrigin-RevId: cf1cb1d58bc8b1abbe0c1b91f4d0e70c447d1699
2024-04-09 14:46:02 +00:00
James Wahlin
009e1ab228 SERVER-86033 Modernize batch_size.js; Fix wrong assumption around sharded cluster data distribution
GitOrigin-RevId: 245f7f2525635acd17776448f6c537af3a7e9c4e
(cherry picked from commit dcb76e916c)
2024-04-09 14:45:48 +00:00
Gregory Noma
e93b799971 SERVER-86280 Reclassify some validation errors as warnings (#19936)
(cherry picked from commit c2d450f833a856c4a7a90b9b2999cf737e86369e)

GitOrigin-RevId: 1526fb46772e42299ea0dc7c1712a4592e5c2fed
2024-04-09 14:45:32 +00:00
Gregory Noma
5353dcb3f5 SERVER-86407 Ensure validation memory usage integer doesn't overflow (#20743)
(cherry picked from commit ef641d3ae5655dd9cd3372c560a2ebb95464cf27)

GitOrigin-RevId: b100aa61ffd356f6664785fb0fa20f420977d875
2024-04-09 14:45:18 +00:00
Jordi Olivares Provencio
18ea4361f6 SERVER-87058 Fail catalog flushes if replication state has changed between start and finish (#19293)
GitOrigin-RevId: 13fcf90d9d09837891a5d628c68ee8bf7239fdec
2024-04-09 13:58:41 +00:00
Robert Sander
2b7df12452 SERVER-86672 Update CollModCoordinator to use the current shardId as the id of the primary shard (#19924)
(cherry picked from commit e30f6c524f03f8925c25a7526396ad559aba0a5f)

GitOrigin-RevId: 4c8f54c9d516f23f52ff756c43cc2aa775f49c6e
2024-04-09 13:58:22 +00:00
wolfee
53b475c023 SERVER-87323 Use shared pointers instead of unmanaged in VectorClockMongoD (#20176)
GitOrigin-RevId: 8fbf9a2ff75f14b1a45799f8ba7675db2fd50775
2024-04-09 13:58:06 +00:00
Jordi Serra Torrens
a5995e39fb SERVER-85583 Running an aggregate on a view may throw IllegalChangeToExpectedDatabaseVersion (#18326)
GitOrigin-RevId: fd9db5b42d95587980a7e1dd4da96e797c7a850b
2024-04-09 12:26:26 +00:00
Pol Piñol Castuera
342a486e7c SERVER-88404 checkMetadataConsistency should refresh if it finds no cached info for database (#20655)
(cherry picked from commit 5c7c97923e4f3fd696368a559686d28b96fa087d)

GitOrigin-RevId: 348bac6e89be01f7bd025fc8c7856250e5c2b058
2024-04-09 12:26:09 +00:00
atesteve
0ec8317e07 SERVER-88262 Increase timeouts in read_pref_with_hedging_mode.js (#20770)
(cherry picked from commit 463e5854cd6e2b2e8b9ff0eba132d9bd2af4a6c4)

GitOrigin-RevId: b400f641b5ac09a21bb16398d84b79a655a0ad76
2024-04-09 12:25:55 +00:00
Adam Farkas
4f817005a2 SERVER-85843 A write operation may fail with NamespaceNotFound if the database has been concurrently dropped (#19249)
GitOrigin-RevId: 7d4ef0ff07970ace2ac19892b7f6b357c9ddc30b
2024-04-09 11:38:07 +00:00
Marcos Grillo
8e48704178 SERVER-84368 Invalidate catalog cache original nss if staleInfo exception is received for timeseries collection (#18004)
SERVER-84368 Invalidate catalog cache original nss if staleInfo
exception is received for timeseries collection

Co-authored-by: Allison Easton <allison.easton@mongodb.com>
(cherry picked from commit b5f58d8cc3853c3bdecba44bf3fdf419fa200cf8)
GitOrigin-RevId: b225e984a0ffc44f048add54e950b3329ecd0b62
2024-04-09 10:51:13 +00:00
Jordi Serra Torrens
9cd1f9f13d SERVER-86583 Ensure non-transactional snapshot reads on unsharded collections operate with a correct sharding catalog
GitOrigin-RevId: 6b142f77285b9af1d42ada3f48ecb37672c6f687
2024-04-09 10:50:59 +00:00
Silvia Surroca
c74316354b SERVER-85580 Undo any update on ScopedSetShardRole construction failure (#18322)
(cherry picked from commit dbc8b1a147093fd9e40bec7350670c2d1f562ce0)

GitOrigin-RevId: aa95e819a6177d3eb02b4c9a82a9afd695044449
2024-04-09 10:06:37 +00:00
Tommaso Tocci
f63260d4c5 SERVER-87610 Relax shardVersionRetry tripwires on the namespace of received stale exceptions (#19737)
(cherry picked from commit aef11e7e3ade447f28ae0d8ebc23256237263b87)

GitOrigin-RevId: b5af03dc756a91162ecc18070bf803d4e928a8aa
2024-04-09 08:49:00 +00:00
Allison Easton
71a20ac1e9 SERVER-86395 CloneAsCapped should not insert documents without timestamps (#18872)
GitOrigin-RevId: 2ace97dbfcce2d9f9e92ec2c40859cab9d0f8dcc
2024-04-09 08:00:08 +00:00
kmznam
d379f938cd SERVER-86419 Fix $bitsAnyClear behavior around invalid NumberDecimal values to match documentation
GitOrigin-RevId: 7139ce8fbeb6c3aca24798e0941a30384b7cb443
2024-04-09 03:10:08 +00:00
Luke Chen
e999896fee Import wiredtiger: 302765eb0d899a87ebced516feaf6245f4dde341 from branch mongodb-7.3
ref: 6f7d3b7947..302765eb0d
for: 7.3.2

WT-12431 Pin the snapshot for mirror verification by an active cursor (v7.3 backport)

GitOrigin-RevId: 2282814bda3c5e423e1504d9d64cd617a98963a4
2024-04-09 02:24:56 +00:00
Luke Chen
8725efc7ac Import wiredtiger: 6f7d3b79479cb9e003bf1005734fe4d03a61b2a5 from branch mongodb-7.3
ref: fbf82914c8..6f7d3b7947
for: 7.3.2

WT-10807 Skip in-memory deleted pages as part of the tree walk (v7.3 backport)

GitOrigin-RevId: b621df85d9fedf584a352d7b25069b66fc238f99
2024-04-09 02:24:42 +00:00
Luke Chen
4c9dcb4a9c Import wiredtiger: fbf82914c810809957f3fa5395c75445eb75f959 from branch mongodb-7.3
ref: c688cc7146..fbf82914c8
for: 7.3.2

WT-12378 Not enough memory error on arm64-small (v7.3 backport)

GitOrigin-RevId: 263c5e7761e11067daa25e96013c4b916a9ff975
2024-04-09 02:24:28 +00:00
Luke Chen
3c9af00708 Import wiredtiger: c688cc7146b707c91599c95cc9a92e78321bb3b7 from branch mongodb-7.3
ref: 1e082a99a7..c688cc7146
for: 7.3.2

WT-12225 Fix RNG generator weakness around mongodb $sample stage (v7.3 backport)

GitOrigin-RevId: 934b212b9a5c003d50ce52ea20e36bfa124cbc97
2024-04-09 02:24:14 +00:00
Luke Chen
ba129e5993 Import wiredtiger: 1e082a99a758bc7ca96f6ea56209a596ecd50ccf from branch mongodb-7.3
ref: ecbeefd06b..1e082a99a7
for: 7.3.2

WT-9820 Halve concurrency level for long-running MSAN tests

GitOrigin-RevId: 960887823fc7a9b499f38e3f3bf00a922642d088
2024-04-09 02:23:53 +00:00
Luke Chen
ef64cafffd Import wiredtiger: ecbeefd06bb24b2b4dbac35dc0518b4e48fe96b3 from branch mongodb-7.3
ref: da2d4104d4..ecbeefd06b
for: 7.3.2

WT-12402 Add stats to track when eviction server skips walking a tree (v7.3 backport)

GitOrigin-RevId: 5161ed3400541a4275e9cfa167ef23c85c505a2a
2024-04-09 02:23:37 +00:00
ppolato
4db3d59901 SERVER-87051 Relax checkHistoricalPlacementMetadataConsistency for tests forging resharding temp collections (#19294)
(cherry picked from commit 18a3bd49906c1ef8f17b6430979570ffaf56f6b7)

GitOrigin-RevId: 56896716dca9600d04b3389f2615b09fa249e5a6
2024-04-02 17:12:30 +00:00
Frederic Vitzikam (fredvitz)
69459718a6 SERVER-86120 Return write error on failure to commit internal txn for retryable update that modifies doc shard key (#20067)
(cherry picked from commit c44f704d60f7354bb1d872b39eff0fdfb75de6b2)

GitOrigin-RevId: e1032150436d7f98b978476099dba5f1cbbf0c8d
2024-04-01 19:25:13 +00:00
Gregory Noma
ca11e90295 SERVER-88200 Check that buckets coll is valid on time-series writes (#20508)
(cherry picked from commit 5f8784fd99ad01d4ad0741c5c221fa77c198245f)

GitOrigin-RevId: b6b8abe910120af936ab35072323e191185b5bfb
2024-04-01 18:40:56 +00:00
Jason Zhang
334a803b7c SERVER-87191 Respect snapshot read concern for writes without shard key (#20058)
(cherry picked from commit 45483ea25e7370f3a5f0d33e4b41b0f8fd026fcd)

GitOrigin-RevId: 0c82e6ac11b46062aab07868d7cc3366469cb731
2024-03-27 15:23:59 +00:00
atesteve
76ae6b0d7b SERVER-88360 Remove tassert for UUID inconsistency check (#20366)
(cherry picked from commit 142984663b0b05c3c256e9bb756cdae9b561fc0b)

GitOrigin-RevId: 68bc89412713c286d921c4b89906351c69d34c75
2024-03-26 18:02:26 +00:00
Maria Prinus
b4d4f70263 SERVER-84497 Bump commit for 7.3.0 GA (#20165)
GitOrigin-RevId: f32b19008ee66de4f916d243a39033e0cd02f658
2024-03-19 21:59:22 +00:00
Parker Felix
cce7c20ebb SERVER-87704 Fix sort key parsing with $top[N]/$bottom[N] in SBE (#19978)
GitOrigin-RevId: f4a5204ca7dbe606d951ea50264a4eedb4bb561d
2024-03-14 20:29:47 +00:00
Varun Ravichandran
15d863aea7 SERVER-87573: Accept OIDC discovery documents that omit token_endpoint
(cherry picked from commit a9d4336f7a0dfcfc830b3c655ea3638f72b43964)

GitOrigin-RevId: 41ed2b5554c7f9b2a18395d7110498481bfcb9cf
2024-03-12 15:56:35 +00:00
Adityavardhan Agrawal
fd3c3712f2 SERVER-87479 Add tests for agg pipeline with trySbeEngine stages wrapped with $group and $lookup (#19672)
(cherry picked from commit 4687054c6d7e67328aaec34612a37ca210d631e3)

GitOrigin-RevId: 8c20d78885d68ce0785edc492160822c0fa5b425
2024-03-08 20:41:12 +00:00
Alice Doherty
261ea5e6ed SERVER-87415 [7.3] Remove dsi_integ_test_run_command_simple from sys-perf (#19751)
GitOrigin-RevId: 0a7d746323d84d7c5fb07cfbf8f423999983368d
2024-03-08 17:52:16 +00:00
Mathis Bessa
c7b7785301 SERVER-87567 The SessionWorkflow should correctly return a response error on malformed requests
GitOrigin-RevId: 218f585aff9d2b154b262e24f1db6534112ba5a5
2024-03-08 17:06:14 +00:00
Will Buerger
eda00ce62b SERVER-86757: Don't error on $search queries that provide internal requiresSearchMetaCursor field (#19670)
GitOrigin-RevId: 124eb119ea9c809032af432ac2e9d88ce17455cf
2024-03-07 20:10:42 +00:00
Alyssa Clark
4901550bc2 SERVER-86749 RunQueryStats hook should ignore all "query stats disabled"
codes for mutational fuzzers suites

GitOrigin-RevId: 19bf25959ce19817845f10e82495ab37f7405b4b
2024-03-05 19:47:36 +00:00
Erin Zhu
b7e17dcfea SERVER-87328: BACKPORT-19113 Fix error code in query_stats_upgrade_downgrade.js
GitOrigin-RevId: 008c64d71383888a02bba4c805a3772f87e2b7bc
2024-03-05 19:47:20 +00:00
Erwin Pe
0fcdb03ee4 SERVER-87330 Accept JWKSets with non-RSA keys
(cherry picked from commit 9960a18e4b9c863ca4916188d27eec70e082c00b)

GitOrigin-RevId: 7ebfeece095cc13a4c92044026ee436ac876f089
2024-03-05 18:51:01 +00:00
Jordi Serra Torrens
b0e83d2ffb SERVER-87061 Check that the sharding catalog and local catalog agree on the collection UUID
GitOrigin-RevId: a503ec734ac25df2dc4feb8612b7861581cedfd0
2024-02-29 15:52:49 +00:00
Benety Goh
de849e664f SERVER-79999 reduce macOS test coverage (#18350)
SERVER-86822 remove sharding_gen task from macos builders (#19213)

(cherry picked from commit c1af0ac85c39053cac9c5af72f6bc98a8d0f79c5)
(cherry picked from commit 285d537afedc92e2a9b57edc8364a2c1faa50852)
(cherry picked from commit 4f213041bbf4ae7921a6d5ceae6e8c8309912f39)

GitOrigin-RevId: ea0852cc1fd282253a6341908f68c70a63e8062d
2024-02-28 19:22:17 +00:00
henrinikku
909764ccf2 SERVER-86889 Add mechanism to make API compatibility check ignore privileges in access checks
(cherry picked from commit 773ac477426b4d1220c8d35627f8bb6eec62740d)

GitOrigin-RevId: c9429dccc725cbe8519fb749f1ff6c81d54443eb
2024-02-28 18:32:22 +00:00
nandinibhartiyaMDB
11f128a8d6 SERVER-86894: Fix data race while accessing internal state. (#19262)
(cherry picked from commit 79fe6c084fa59dcfb46334a0a6e5b03389ad2bfb)

GitOrigin-RevId: 2b6b2907e7afcca18edef85d54e2e6dc2ef9839c
2024-02-28 00:01:04 +00:00
Adam Rayner
4678ac187e SERVER-85567 Allow sessionless use of HelloMetrics
(cherry picked from commit ef7b68e51b5153b0c38d74c89c13135ecf19835b)

GitOrigin-RevId: ac1857f3c430c6afa5fc36ee45447be48cd6a9c6
2024-02-27 16:39:21 +00:00
Moustafa Maher
83db40548b SERVER-85890 Oplog application of dbcheck batch entry can fassert if namespace was collection that is recreated as view (#18958)
(cherry picked from commit 926b6deee9880af4fad3609fcdfed3af1af265e4)

GitOrigin-RevId: e634797b311b6c2ffa83e34cd95acccb6a240135
2024-02-27 06:41:14 +00:00
Silvia Surroca
869301c9b1 SERVER-78852 Test movePrimary and out running concurrently (#14379)
(cherry picked from commit f820f41dbbff1a396078cb382c66f227a5715e1e)

GitOrigin-RevId: c9c800be4d44e7b5f4d150ed6d43fc7822230734
2024-02-26 18:11:36 +00:00
Silvia Surroca
436e8f0bb6 SERVER-86634 A collection that ends with ecoc.compact must be considered a FLE collection (#18986)
(cherry picked from commit fc7d2a0c4860ae8e6a2d995427fb1d52c64a66d8)

GitOrigin-RevId: d40b8725d40be1e1f6ef79b9b4eefccbe7ef2069
2024-02-26 17:21:21 +00:00
Erin Zhu
feb389d0dc SERVER-86744 /BACKPORT-19046 Backport Fix query_stats_upgrade_downgrade test to v7.3
GitOrigin-RevId: 16bdd43e180a0cad6446f0fb57c52b50a4bf84f1
2024-02-26 16:27:04 +00:00
Suganthi Mani
90094e0e71 SERVER-83596 OplogBufferCollection methods should not fassert on interruption errors; instead, they should pass these errors to the callers. (#19145)
(cherry picked from commit 88a71df51abc58d2db25c6ed120f01b935bb5166)

GitOrigin-RevId: 0243683cfc6c01184c37516c42a52d1f28295755
2024-02-26 15:36:25 +00:00
Jordi Olivares Provencio
3854d5ee56 SERVER-86355 Propagate error from sharding database cache refresh (#18777)
GitOrigin-RevId: 4686e79e30c54390edf36f7ab9bc5e3aef3a1834
2024-02-23 18:48:02 +00:00
Kshitij Gupta
1a60523b04 SERVER-86930: downgrade_from_autobootstrapped_cluster.js should use featureFlagTransitionToCatalogShard
GitOrigin-RevId: aee59ba96c6622b55fa2479d59c309e7b9fe4c00
2024-02-23 18:04:18 +00:00
kshitij
40af9a1178 SERVER-86870: Use safer method to check gFeatureFlagUpdateOneWithoutShardKey feature flag. (#19151)
(cherry picked from commit 6a34c8320639a7e2687c795d88b63f4d082de12f)

GitOrigin-RevId: 40e44e36399b06fc732a8066e83f768a0ef952b1
2024-02-23 18:03:51 +00:00
Kshitij Gupta
294ef9d8aa SERVER-84548: Use shard server catalog cache loader if not running in catalog shard mode.
(cherry picked from commit 603d6b0ebdbd5e2bf78a0b2a0ee664adbbd3c713)

GitOrigin-RevId: 85834588bf7aea46fa91bccc4668d61b16f7a9cc
2024-02-23 18:03:36 +00:00
Thomas Langston
3050ca21d0 SERVER-86106: Fix shadow-utils package on suse (#18641) (#19120)
GitOrigin-RevId: c0fffc0315815ceb2717f6b582bfe444e0a041c0
2024-02-22 17:23:16 +00:00
Jordi Serra Torrens
e156c06033 SERVER-84723 Ensure sharding catalog is valid when acquiring collections in multi-document transactions (#18193)
GitOrigin-RevId: fdfa7f0e5d4bf026af4d3990bc2bdaa604945a55
2024-02-22 16:31:56 +00:00
Patrick Freed
52a7871d80 SERVER-86694 Fix crash when AsioTransportLayer is shut down between setup and start (#19073) (#19114)
GitOrigin-RevId: 5eff1aa2d23b15324f92a8f596175ae17c56a409
2024-02-21 20:13:46 +00:00
zixuan zhuang
2063be6618 SERVER-86424 Fix searchSequenceToken metadata
GitOrigin-RevId: 7636492d4f8a7243faedb54ae0d5f4933a29a8c0
2024-02-20 20:27:41 +00:00
Benety Goh
b8d9f8f23a SERVER-86632 plan_cache_drop_database.js should catch DatabaseDropPending errors (#19062)
(cherry picked from commit 85085bf31367e028b5b20fa1638ecbd93d3d60a6)

GitOrigin-RevId: bc38d13adad4c14f1e1b4e19dce330e97531e140
2024-02-20 18:28:20 +00:00
Benety Goh
7734f5c809 Revert "SERVER-79999 reduce macOS test coverage (#18350)"
This reverts commit 285d537afedc92e2a9b57edc8364a2c1faa50852.

GitOrigin-RevId: dda93e4eede53ae7de4f28ab7085527d25d79ea9
2024-02-20 17:42:16 +00:00
Ted Tuckman
bd91b2124d SERVER-86417 Change $vectorSearch filter obj to be owned
GitOrigin-RevId: 52104805010ffa4ea36a7dabf067534fb083bb68
2024-02-20 14:49:46 +00:00
Ian Boros
d4cb125a5a SERVER-86619 Fix out-of-bounds access bug in Document for empty field (#18997)
(cherry picked from commit c5f723d2b759956381360bbbcd4d8606fc733da6)

GitOrigin-RevId: cf5a3a6a7cadcfe93a84cbeb308a88323b46bdbf
2024-02-20 03:03:14 +00:00
Pierlauro Sciarelli
ec43363ae6 SERVER-86340 Use a different feature flag to protect collections creation inside distributed transactions (#18817)
GitOrigin-RevId: 44aaa122b6a0c7f3621a78434371b2c68ebb6445
2024-02-19 16:58:31 +00:00
Jordi Olivares Provencio
704c07df7b SERVER-86624 Fix RSLocalClient behavior with snapshot readConcern
GitOrigin-RevId: 32100c26a0cd6a292d4f6a8aa5f81c802fe25765
2024-02-19 15:35:28 +00:00
madelinezec
f3a8318d39 SERVER-85543 correct $skip + $limit pushdown test
GitOrigin-RevId: 0a5aa4340af5ecac7a4d874374824925dc9189fd
2024-02-16 21:33:28 +00:00
Haley Connelly
48011aecaf SERVER-84589 Update drop timeseries buckets collection error message (#18431)
(cherry picked from commit 09ed5a3568046863fc034463dfbd1a3fca074cd3)

GitOrigin-RevId: cdffb1121e6783578dc69a1625e86cf4e3b62045
2024-02-16 19:27:33 +00:00
atesteve
3433201a22 SERVER-84384 Resharding test infrastructure must be resilient to intermittent errors (#18767)
(cherry picked from commit 8e4947825046a1a734c822c264b3d5a2134a03a4)

GitOrigin-RevId: cb8428aa864ae41200f82a8999ac01f248b4d430
2024-02-16 15:26:49 +00:00
Antonio Fuschetto
d89fe94652 SERVER-86705 Increase TTL index timeout in ttl_deletes_not_targeting_orphaned_documents.js (#19041)
GitOrigin-RevId: 0aac76c08351da899f930fdb9bc5dde5d7310734
2024-02-16 14:42:52 +00:00
Parker Felix
019401a92d SERVER-86700 convertToCapped also expects NamespaceNotFound error (#19038)
GitOrigin-RevId: 114b54981a370367deba30a58f8d69cc21ff1759
2024-02-16 00:06:14 +00:00
henrikedin
f55f6c86cb SERVER-86065 BSONColumn structural validation should check for nested interleaved mode (#18607)
GitOrigin-RevId: 1380ef3f793aa067aa66897f63fba999b33fe881
2024-02-15 19:28:46 +00:00
Adi Zaimi
7cb1769232 SERVER-85456: omit bench_test1.js from the fcv up/down suite (#18612)
GitOrigin-RevId: c86fa812f3b362896e8acde086fe5debb770a67e
2024-02-15 05:27:53 +00:00
romanskas
f3c00b49cf SERVER-86454 Merge canSwapWithRedact and canSwapWithSingleDocTransfor constraints (#18973)
The 'canSwapWithRedact' and 'canSwapWithSingleDocTransform' constraints
are used in the same cases and treated identically, therefore it is
preferable to merge them and remove the redundancy in the code.

GitOrigin-RevId: 837174eb3ba326b489732a5db9bc2acad8a052b1
2024-02-15 01:43:16 +00:00
Louis Williams
c8f81303ab SERVER-86236 Add back throughput probing metrics (#18866)
GitOrigin-RevId: a9428fc0e9f38bd1903282a2a7efd9846c0a7d7e
2024-02-14 22:06:17 +00:00
Louis Williams
be43f228cd SERVER-86247 Fix non-Linux TicketHolder starvation (#18797)
GitOrigin-RevId: 8ef55d6b723877a749d470761b040052f92c89e8
2024-02-14 22:06:02 +00:00
Adityavardhan Agrawal
c65d95cafa SERVER-86507 Disable search in sbe (#18918)
(cherry picked from commit b83c045275f55134671bf6073e0d6beb77a22522)

GitOrigin-RevId: 380e96b49355d8b73ec10a596ca2fc05c7c4631b
2024-02-14 19:55:40 +00:00
Jordi Olivares Provencio
2851ed67a8 SERVER-85534 Checkpoint configTime after create coordinator commits
GitOrigin-RevId: 6ae6315f2ebb0f22f5f77c4486715ac765e48e51
2024-02-14 12:08:06 +00:00
Ted Tuckman
611be7102c SERVER-86273 Fix searchSequenceToken in classic $lookup
GitOrigin-RevId: f45609ecc433b90d24aa37c71cc330fcbeac4bec
2024-02-13 21:35:02 +00:00
Jordi Olivares Provencio
18fbed9ddb SERVER-85869 Make shard registry use snapshot readConcern for config.shards reads
GitOrigin-RevId: 6e6fc824408fb1627a13b168d63f06272c0d7f63
2024-02-13 16:27:27 +00:00
Max Hirschhorn
ae43eac0f0 SERVER-86481 Run Jepsen set, register, read concern majority tests.
Introduces a testing-only Ubuntu 18.04 build variant until Jepsen
dependencies are installed on a modern Evergreen distro.

GitOrigin-RevId: 7a1be768b8e7f9f64b467e92009b50902370ee74
2024-02-13 14:36:59 +00:00
romanskas
00d5af64dd SERVER-85848 Treat $redact as single-doc transform for change stream stages (#18900)
The internal stages DSCSEnsureResumeTokenPresent and
DSCSHandleTopologyChange are permitted to swap with single-document
transformation stages during optimization to allow user-specified stages
to be moved closer to the front of the pipeline and to be pushed down to
the shards in a cluster deployment. The $redact stage is allowed in a
change stream pipeline, but it is not internally implemented or
recognised as a single-document transformation; it therefore does not
get moved ahead of the change stream stages mentioned above. This can in
turn decrease the performance for stages after $redact and fail the
$changeStreamSplitLargeEvents stage in a cluster deployment. In this
change we treat the $redact stage similar to single-document
transformation stages during the change stream pipeline optimisation.

GitOrigin-RevId: 28936935ab02ccbd27b605f2a04923151f0f0341
2024-02-13 01:26:53 +00:00
Shin Yee Tan
5659068ea0 SERVER-85690 Add awaitNodesAgreeOnPrimary after stepdown in index_build_unregisters_after_stepdown.js (#18362)
GitOrigin-RevId: 85f9e945cc069800a771a4f8c23d3e733eb7cd6c
2024-02-12 21:25:46 +00:00
Benety Goh
ce3b70ec2c SERVER-86158 fix TTL operation metrics tests to accommodate slow deletes (#18750)
(cherry picked from commit b5347cb0a1057502f79b65a158fb53d6bb095ed1)

GitOrigin-RevId: 984b8237b0ebdb0eb2822bb91b710bee8213ebcc
2024-02-11 17:32:35 +00:00
Benety Goh
1b9023e8e6 SERVER-85925 run collMod using nested CurOp during FCV upgrade (#18556)
(cherry picked from commit beec06b6371b1e30acca9886aecd70a379095a65)

GitOrigin-RevId: 5b53b608004bc82524398fa8c331ed7b4cc9d04e
2024-02-08 21:27:29 +00:00
Niaz Pavel
1fbea37238 SERVER-85458 fix expected secure allocation count in secureAllocBytesCount test in secure_allocator_test.cpp
GitOrigin-RevId: a985aed681ddc90ade6b1617aa02b87cdff0327e
2024-02-08 18:45:38 +00:00
Alberto Massari
8cf243ea6e SERVER-86339 Enable vectorization only inside TS bucket unpacking (#18831)
GitOrigin-RevId: 5a84d4502ba4e6e64aa4835eeab2947c802f82c7
2024-02-08 18:45:24 +00:00
Matthew Russotto
43a29b25f9 SERVER-84653 Make the auto_safe_reconfig_helper tests wait for newly added removal
(cherry picked from commit 41d3bce6cdd0f9d5f84d98c566e98a8214d7280f)

GitOrigin-RevId: cc27ee807bd328fa4915620399fb8d0e54d15210
2024-02-08 17:57:07 +00:00
Projjal Chanda
669570c3fe SERVER-86257 Replace invariant() with tassert() in vectorized instructions (#18818)
GitOrigin-RevId: 3fc056d08066772f3885a36bbbc1b92b81ebedad
2024-02-08 11:53:04 +00:00
Benety Goh
b7284d6bed SERVER-79999 reduce macOS test coverage (#18350)
(cherry picked from commit c1af0ac85c39053cac9c5af72f6bc98a8d0f79c5)

GitOrigin-RevId: 285d537afedc92e2a9b57edc8364a2c1faa50852
2024-02-07 23:52:58 +00:00
dylrich
22525383b3 SERVER-86363: Make container registry login silent (#18791)
GitOrigin-RevId: 179099ffc1270f5e918b41a710bf73e23495647d
2024-02-07 23:04:23 +00:00
Wenqin
1eee54b950 SERVER-85452: Retry updating config.shards if sharding is not ready (#18523)
GitOrigin-RevId: 636391b003f1de818659521c21abec223f76eaf3
2024-02-07 18:27:15 +00:00
Misha Tyulenev
021916df31 SERVER-85692 ignore optimizationTimeMillis in js test (#18361)
GitOrigin-RevId: 11edcbad6daa47bb36b346f4d58d41a7eecdd070
2024-02-07 17:23:15 +00:00
James Bronsted
7e4ecfffbb SERVER-86099 disable tests that depend on diagnostic latches in enterprise-amazon2-streams (#18691)
(cherry picked from commit a9b886908ecd39f1b62a2fd013a6d50865a52174)

GitOrigin-RevId: cb1e7679033578f5374c8ed77050a278cabe8e42
2024-02-06 19:44:30 +00:00
Will Buerger
ca28a130ba SERVER-85453: Make ExternalDataSourceScopeGuard only compatible with one plan executor
GitOrigin-RevId: 76ffc31436ea6dc3ed16a504621c59434548106c
2024-02-06 19:00:33 +00:00
Parker Felix
f7d530b603 SERVER-86165 Backport: Avoid stepdowns in merge_command_options.js (#18723)
GitOrigin-RevId: 73ebea7aaf788562fbe84ffcf7ea1363cab723c6
2024-02-06 16:47:53 +00:00
Luke Chen
ebde5104eb Import wiredtiger: da2d4104d45a0068bc51f512dd91263847ef278a from branch mongodb-7.3
ref: aac489874e..da2d4104d4
for: 7.3.0-rc2

WT-12366 Fix the session prev prefetch ref flag usage to skip the page

GitOrigin-RevId: ad87c79436081309cfa313f06837f22da64c7679
2024-02-06 04:51:51 +00:00
Luke Chen
aa641cd5ae Import wiredtiger: aac489874e816e103f2634231c75b78df6581641 from branch mongodb-7.3
ref: 5c5f4fad24..aac489874e
for: 7.3.0-rc2

WT-12239 Python script to run wt verify

GitOrigin-RevId: d4f4cfa5d8be66119cab7f18aced42f236c2d68f
2024-02-06 04:51:37 +00:00
Luke Chen
b151bf69fb Import wiredtiger: 5c5f4fad24bbb6a3b0d94dd64fd063644cda69a1 from branch mongodb-7.3
ref: 7991477ad9..5c5f4fad24
for: 7.3.0-rc2

WT-12364 Replaced WT_ASSERT() calls in Catch2-based unit test code with REQUIRE()

GitOrigin-RevId: a204ab18f011c3277ba20ae0f28f26700ac8cb10
2024-02-06 04:51:23 +00:00
Luke Chen
78392359e9 Import wiredtiger: 7991477ad97cf3dc7962f7740600570ed4228139 from branch mongodb-7.3
ref: 96e20c88f3..7991477ad9
for: 7.3.0-rc2

Revert "WT-12363 Remove checkpoint state update outside lock

GitOrigin-RevId: 812790349a78a93d454a5cce719e3db1b731108e
2024-02-06 04:51:10 +00:00
Luke Chen
fcb40bb2fa Import wiredtiger: 96e20c88f388f89032dfaaaae38b291b69bfbf4c from branch mongodb-7.3
ref: 646cfd19e6..96e20c88f3
for: 7.3.0-rc2

WT-12363 Remove checkpoint state update outside lock

GitOrigin-RevId: d84d3c658344f26d44aa31ed63c87824c0918ff5
2024-02-06 04:50:56 +00:00
Luke Chen
eaf0367edc Import wiredtiger: 646cfd19e6e99655c329edcbcd04d026638509a8 from branch mongodb-7.3
ref: f7e34637c2..646cfd19e6
for: 7.3.0-rc2

WT-12233 Standardise dump_pages output for parsing

GitOrigin-RevId: cbec71df61e467a37212bb4a1b8fec96f5152383
2024-02-06 04:50:42 +00:00
Luke Chen
1b3507dcf4 Import wiredtiger: f7e34637c2995e931dbe5767576bed5e9ae15cf4 from branch mongodb-7.3
ref: 98cd5f647a..f7e34637c2
for: 7.3.0-rc2

WT-12086 Investigate replacing macros with inline functions

GitOrigin-RevId: 7ab2b35e666a1bb9cda871bf3ff64b28be47e12d
2024-02-06 04:50:28 +00:00
Luke Chen
6fd5c3b35b Import wiredtiger: 98cd5f647a3032d97fdce3aace9ab96e7469df78 from branch mongodb-7.3
ref: f00009d0ff..98cd5f647a
for: 7.3.0-rc2

WT-12328 Stop compacting if a file has grown in size between passes

GitOrigin-RevId: 348686c5969ef1ee6b90c45eefbc9668096e38ee
2024-02-06 04:50:15 +00:00
Luke Chen
4d7d4d68f9 Import wiredtiger: f00009d0ffc88f364123778fa919185c87e1fb56 from branch mongodb-7.3
ref: b06f00b0e2..f00009d0ff
for: 7.3.0-rc2

WT-12283 Make s_all and s_fast faster on MacOS

GitOrigin-RevId: d5a887872550b7e11ffd882d79d0f57d4c3697ea
2024-02-06 04:50:01 +00:00
Luke Chen
849b987eb6 Import wiredtiger: b06f00b0e26f2ae0e4ada0f59fc2d3a5527c827f from branch mongodb-7.3
ref: 1085958ce9..b06f00b0e2
for: 7.3.0-rc2

WT-12157 Moving verbose message into backup cursor creation

GitOrigin-RevId: 9bcb5dc28a8ae392894cf7e994dac84ee816f6a2
2024-02-06 04:49:48 +00:00
Luke Chen
661e815bd8 Import wiredtiger: 1085958ce9eae7c3d6c04b3f4578cbab68bea656 from branch mongodb-7.3
ref: f595451401..1085958ce9
for: 7.3.0-rc2

WT-12321 Track opened bulk cursors

GitOrigin-RevId: 69ce75ed126e451385ddf70d450521da7f779e2e
2024-02-06 04:49:34 +00:00
Luke Chen
44d504f0de Import wiredtiger: f59545140192064fe40a0197bf6ed079b73f7e34 from branch mongodb-7.3
ref: 1ae31f5bb8..f595451401
for: 7.3.0-rc2

WT-12295 Leave the WT_GEN_COMMIT commit generation after releasing the snapshot

GitOrigin-RevId: faff501659618411c2dc8f627228a5e4e771bf39
2024-02-06 04:49:20 +00:00
Luke Chen
82be9b0ef6 Import wiredtiger: 1ae31f5bb8b46ef3320ad133bb21636d4862b1eb from branch mongodb-7.3
ref: 99791df059..1ae31f5bb8
for: 7.3.0-rc2

WT-11621 Implement a workload generator for the model

GitOrigin-RevId: 17d588f24a5b20d69e0cb7a7d4f3c3d1d8e6891e
2024-02-06 04:49:07 +00:00
Luke Chen
87c8995e14 Import wiredtiger: 99791df059abc398a20d50fb0078c7558b601e64 from branch mongodb-7.3
ref: d5be6ac253..99791df059
for: 7.3.0-rc2

Revert "WT-12319 Estimate compaction work again when expected work is done"

GitOrigin-RevId: ef36352a729cfa43dcb15cb2c8659cc32689540d
2024-02-06 04:48:53 +00:00
Luke Chen
da0e32209e Import wiredtiger: d5be6ac2534fa1df4da5721f5434b31dd0b8a024 from branch mongodb-7.3
ref: f8c19440cd..d5be6ac253
for: 7.3.0-rc2

WT-12234 standardise wt tool verify dump_blocks output

GitOrigin-RevId: 82750c07e4b8993a804084955b0ca134c83eabc7
2024-02-06 04:48:39 +00:00
Luke Chen
7f9bdad993 Import wiredtiger: f8c19440cdfc094bdfecd43ab6539a6004c36894 from branch mongodb-7.3
ref: 44c89ade32..f8c19440cd
for: 7.3.0-rc2

WT-12338 checkpoint-stress-test should wait for all jobs to finish

GitOrigin-RevId: c902aa4af2e3bf59562b83171bbf677ad6aecb1f
2024-02-06 04:48:26 +00:00
Luke Chen
fa1a28e05f Import wiredtiger: 44c89ade32cecdec8b1577439429a6b28557276b from branch mongodb-7.3
ref: 4c87b00ede..44c89ade32
for: 7.3.0-rc2

WT-12319 Estimate compaction work again when expected work is done

GitOrigin-RevId: abb94b3665b6dc33c7f144cbd20c6efcfe39689a
2024-02-06 04:48:12 +00:00
Luke Chen
269cbad647 Import wiredtiger: 4c87b00ede03f988bc96deb8a79a5224058bede6 from branch mongodb-7.3
ref: 61afb83f0b..4c87b00ede
for: 7.3.0-rc2

WT-12245 Improve WT_STRING_MATCH performance

GitOrigin-RevId: 2d8661ce74e79d86051ea3462e0685ce5070d690
2024-02-06 04:47:59 +00:00
Luke Chen
ea450b46ee Import wiredtiger: 61afb83f0b84c5c92619c2a5906f220308823416 from branch mongodb-7.3
ref: 85e098243d..61afb83f0b
for: 7.3.0-rc2

WT-12330 Reset testutil tiered storage options when closing connection

GitOrigin-RevId: 2acc5db9ec976641e275ac315749f80681e7a937
2024-02-06 04:47:45 +00:00
Luke Chen
9fc12c963f Import wiredtiger: 85e098243d1ea2c304ae53e451beec1fe540e6b3 from branch mongodb-7.3
ref: 2d0e64d411..85e098243d
for: 7.3.0-rc2

WT-10683 Add key unredact and value unredact flags

GitOrigin-RevId: 8e4deb26d0a6f4c4740dd710f63b1826de7a7d09
2024-02-06 04:47:31 +00:00
Luke Chen
4dfa70cd8e Import wiredtiger: 2d0e64d4119895a0b1d23d18e507c694790a16ba from branch mongodb-7.3
ref: 583b41028b..2d0e64d411
for: 7.3.0-rc2

WT-12314 Quit compaction early if there is no expected work

GitOrigin-RevId: 5ea0e8a296c1bfbf3b15dd82396aed225cb17796
2024-02-06 04:47:18 +00:00
Luke Chen
206829817b Import wiredtiger: 583b41028b9fa99691cbec0c0b7a40b914bac604 from branch mongodb-7.3
ref: b91fdb0b90..583b41028b
for: 7.3.0-rc2

WT-12261 Fix python test suites failing to preserve files

GitOrigin-RevId: f84b481ba1177e7fde274c1b62cbb7e79d6151bd
2024-02-06 04:47:04 +00:00
Luke Chen
27613aa7ed Import wiredtiger: b91fdb0b90996eccba72d5751316066f7a1aad0b from branch mongodb-7.3
ref: 4c91497800..b91fdb0b90
for: 7.3.0-rc2

WT-12138 Create a flag or mechanism for identifying pre-fetch thread sessions

GitOrigin-RevId: 99999ce452ddddaddf2abbc4907690c05eae4452
2024-02-06 04:46:50 +00:00
Luke Chen
0e11db2197 Import wiredtiger: 4c914978009234f1c8573e6534e1677ba8bfdbe8 from branch mongodb-7.3
ref: b0172c9645..4c91497800
for: 7.3.0-rc2

WT-9954 Fix bulk cursors and tiered checkpoints. Enable tests.

GitOrigin-RevId: 3babbbf22db71dc9a59bd2df3d7b4d4b9036fcc6
2024-02-06 04:46:31 +00:00
Luke Chen
8747b02c26 Import wiredtiger: b0172c96455e13f4cea5bbb2199de3ca539d7a5a from branch mongodb-7.3
ref: 8decade11f..b0172c9645
for: 7.3.0-rc2

WT-12304 Alternative messaging for RTS progress.

GitOrigin-RevId: b0ea3f9b0207eb7bd40ff5979da621e47552be7c
2024-02-06 04:46:18 +00:00
Erwin Pe
07e7583e16 SERVER-85693 Fix potential access violation in User::validateRestrictions
(cherry picked from commit cff73e33b92545f5131677112ddb8e5349bbbbfa)

GitOrigin-RevId: d2022fd97d6e1dac73bbae724e44d271ee90cb43
2024-02-06 00:11:12 +00:00
HanaPearlman
fdc13a4114 SERVER-83610: Reduce required privileges for $documents by marking it… (#18702)
[SERVER-83610](https://jira.mongodb.org/browse/SERVER-83610): Reduce
required privileges for $documents by marking it as an initial source

Aggregations starting with $documents do not read from a collection;
they produce the data specified in the $documents stage. So, these
queries should not require any particular namespace privileges aside
from those required by other document sources in the pipeline. This
change makes it so that $documents is marked as an "initial source" to
indicate that it does not require any particular namespace privileges.

GitOrigin-RevId: fa0030e240db99549a3d57fc03e60065a6b31252
2024-02-05 22:10:39 +00:00
henrikedin
6582a6ada4 SERVER-84336 Fix synchronization of timeseries unordered insertMany when exception is encountered and the thread has multiple write batches (#18099)
SERVER-84336 Fix exception handling of time-series unordered insert many
with multiple write batches

Threads now attempt to abort any write batches and wait until no other
thread is trying to commit the data before proceeding with tearing down
the command when an exception is encountered.

(cherry picked from commit bc1b48cc91e7ea05c96f7fb8f4ae2a905baeddab)

GitOrigin-RevId: 3d28db081d34daadfa6a8e47ac3f904a7ba4b232
2024-02-05 15:15:06 +00:00
Charlie Swanson
ad6e38e8d7 SERVER-85694 Ability to parse serialized output for $searchMeta (#18633)
GitOrigin-RevId: 57e0107998c45c39dcd8b90ed97a99b326aaa5df
2024-02-02 21:51:36 +00:00
Santiago Roche
d75cd65a10 SERVER-85485: Fix serialization of legacy geo expressions. (#18266)
GitOrigin-RevId: 8ed89c57231f4f9b52e47cc3ebeaaebcfa349a56
2024-02-02 10:21:11 +00:00
Ahmad Shah
205c77fcd7 SERVER-86081: Include redacted secrets in expansions.write for dsi in 7.3 (#18626)
GitOrigin-RevId: 5dc0a904b1bc51749cf1e0a555e51ea0af71dc29
2024-02-02 01:10:16 +00:00
Binh Vo
569b9c5a9f SERVER-85716: Fix for empty input to BSONColumn validation (#18381)
GitOrigin-RevId: ad2745ecf10106325b9540e895db7ecf0f866448
2024-02-01 19:13:07 +00:00
Daniel Moody
ace2e748ff SERVER-86019 remove left over compile_all (#18557)
(cherry picked from commit 217481263b7f23c3601e8da933f8033997417dae)

GitOrigin-RevId: 41e5972abed8aab16d0e4abd67781e9092c01f4a
2024-02-01 17:55:42 +00:00
Daniel Moody
8a0efad463 SERVER-85682 add some missing unittest coverage (#18351)
(cherry picked from commit ef22b2853f29e36ff86c78e8f3d5627508252826)

GitOrigin-RevId: bf6965e075f3e5e75ff46d1533b67a7c96e3eb1f
2024-02-01 17:55:18 +00:00
Daniel Moody
247774c59f SERVER-85171 split up unittests (#18251)
(cherry picked from commit a92fc2bc46c1fdef8dfe2ef29e3347f39cbc0ad7)

GitOrigin-RevId: e51923f07216b3e2c9f7637505e64b59a5f7192c
2024-02-01 17:55:02 +00:00
Nandini Bhartiya
a27e01b241 Revert "SERVER-84463: Replace withOneStaleConfigRetry with shardVersionRetry (#18252)"
This reverts commit 34dccfb046c91c44a1622dfc054e4b1fdaa19d23.

GitOrigin-RevId: daa9e1ee471d28e79980ca993a8f9a87c1d5e86d
2024-02-01 16:58:44 +00:00
adriangzz
b3537af626 SERVER-85633 Add lock around res_ninit call (#18355)
GitOrigin-RevId: d56320f7d92b1075d1076db1b155241c0cc3a4c1
2024-02-01 01:30:51 +00:00
Ali Mir
aee098711f SERVER-86027 Tag insert_docs_larger_than_max_user_size_standalone.js with requires_persistence and requires_replication (#18567)
(cherry picked from commit b6ad89e483da93863dc7c83df60105dbdef24b94)

GitOrigin-RevId: 469cf9e361cff12cf5b72a5845519b12f672c2a3
2024-01-31 21:07:37 +00:00
Gil Alon
4bfedd77a3 SERVER-85780 Increase timeout and decrease number of generated files in the timeseries fuzzer (#18462)
(cherry picked from commit b38cc8dd000c2bb71707353fb70d489e106b8969)

GitOrigin-RevId: 4d31f560d841e13882d7754ad19b320436b368dc
2024-01-31 20:23:38 +00:00
Wenqin
fea4bc28da SERVER-79796: applyOp in ReshardingOplogApplicationRules sets lock acquisition deadline on opCtx (#18072)
(cherry picked from commit b89480eab9e39c7e0b904c016987d6dba6e6fc25)

GitOrigin-RevId: 701a9b24025ddc9ce4041f9d2341a2324f67f9ec
2024-01-31 18:17:22 +00:00
Silvia Surroca
18f923e6ad SERVER-85419 Balancer pollutes logs in case no suitable recipient is found during draining (#18286)
(cherry picked from commit 8aba060e45e9d5f752992252fb1894c12356d7f1)

GitOrigin-RevId: 9efa9c85d478fccacb5e4b157b0b556b9853de69
2024-01-31 09:30:35 +00:00
Wei Hu
1a51ea6c57 SERVER-85167 Shut down WiredTigerSessionCache before rollback (#18443)
GitOrigin-RevId: 17f19349b9cfc17040ac6f314880d5a70f69b792
2024-01-30 23:33:10 +00:00
HanaPearlman
1be5f7ee3a SERVER-85725: Increase timeout for aggregation_wildcard_fuzzer on ASAN
variant and disable the task on debug variants

GitOrigin-RevId: 76cceceeb983d03fc5a3147efc27146037b800fe
2024-01-30 16:29:03 +00:00
Alice Doherty
2673c8af9f SERVER-82708 [v7.3] Update variants used to performance test stable branches (#18452)
GitOrigin-RevId: a0f4ae0664f4839a86c5581cfca7725039bb16e7
2024-01-30 16:28:49 +00:00
Mariano Shaar
fadb694461 SERVER-85376: Fix accumulator re-parsing with arrays
GitOrigin-RevId: 4e84b84628c3439c4787ac32005a23c43eda5671
2024-01-30 06:09:23 +00:00
Ali Mir
1db1781b4a SERVER-84722 Create internal server parameter to allow users to insert documents larger than the 16mb maximum user BSON size (#18255)
(cherry picked from commit 7b27c54d39d8146fc31fd1959d92df78e75d4f2b)

GitOrigin-RevId: 77d77b0781ab0697e7454c59f8da798813239c6b
2024-01-30 04:12:32 +00:00
Suganthi Mani
d5ea3dac13 SERVER-85836 TenantFileImporter service skips the feature document while iterating through the donor mdb_catlog table. (#18444)
(cherry picked from commit f6698560cf818fa8527614205353e290910096ee)

GitOrigin-RevId: 63456a288f5e1e92d31b57dcb8a6e0bbd457fff4
2024-01-29 21:07:15 +00:00
Drew Paroski
aff37634d1 SERVER-84274 Make InListData sort and dedup its elements up-front
(cherry picked from commit 5ca5fc25ef24c4d661de66ab0765dca523969f13)

GitOrigin-RevId: 1b35becc32d3f54d5f962ae38f7791c3e1fea982
2024-01-29 20:20:32 +00:00
fotiniAlvanaki
14aa64d6b6 SERVER-85776 Disable facet_stats in replicated settings (#18417)
GitOrigin-RevId: d36f072d36f9208301efeb3940c7bd823a812a28
2024-01-29 18:04:02 +00:00
Peter Volk
95d46b131d SERVER-85771 Make $bucketAuto more robust in the case of an empty string for the groupBy field (#18450)
GitOrigin-RevId: d63e6784642d989884912bf760d0753e3a07fb4a
2024-01-29 13:42:39 +00:00
Luke Chen
7c1b294c31 Import wiredtiger: 8decade11fc2dac7e3c1ab7d691fefcf918ab1ff from branch mongodb-7.3
ref: de2cf593c4..8decade11f
for: 7.3.0-rc2

WT-12301 Fix invalid memory access of prefetch_prev_ref

GitOrigin-RevId: 52f00faa38b9aea76eaf40c2232f84c68cbd85c4
2024-01-29 05:27:15 +00:00
Luke Chen
ce048b2b05 Import wiredtiger: de2cf593c444cf3f5b4b34ee3bce0d3435de4b90 from branch mongodb-7.3
ref: d3faff25c4..de2cf593c4
for: 7.3.0-rc2

WT-12311 Update compact progress message related to estimated work

GitOrigin-RevId: af83b4d05e28ccf8aa909c757d305716c926fe03
2024-01-29 05:26:53 +00:00
Luke Chen
8bfcd7953a Import wiredtiger: d3faff25c4e8b1c7708994aa3dfa1b08e1b7575d from branch mongodb-7.3
ref: cde5a05ec1..d3faff25c4
for: 7.3.0-rc2

WT-12305 Add information log printf around restart.

GitOrigin-RevId: dbb3db1d2c66e58d50b907b23d2f17077e4709a1
2024-01-29 05:26:39 +00:00
Gregory Wlodarek
fd774ca2e8 SERVER-85801 Avoid small-string optimization in timeseries_tracking_allocator_test.cpp (#18429)
(cherry picked from commit 180fc2fda26104679ec5123fbfcd1ef47beed772)

GitOrigin-RevId: ef0de3d89ea7f4a20d08e8f3392eb837d59d6b89
2024-01-27 02:57:21 +00:00
Adi Zaimi
3debbda0ff SERVER-83879: Omit running profile_lookup.js in fcv up/down suite (#18267)
SERVER-83879: Omit running profile_lookup.js in fcv up/down suite
GitOrigin-RevId: a9e2a6516cfb9da91262c1b82c0c254539d27749
2024-01-26 23:57:22 +00:00
Alberto Massari
c8ee3ae3ef SERVER-85516 Fix MatchExpression parameterization to assign the correct reused parameter number (#18412)
GitOrigin-RevId: a491f4018fa0663316a83e5b5ccc19ab91d1cd74
2024-01-26 20:11:56 +00:00
Parker Felix
4af8f6496d SERVER-85422 / BACKPORT-18544 Always add a blockToRow stage even when no block fields are required (#18424)
GitOrigin-RevId: 00bcb0080ae37cfaa65497ec35415933b1c0dc0c
2024-01-26 20:11:41 +00:00
Louis Williams
e76c1f5de4 SERVER-83145 Correctly track memory usage in SharedBufferFragment (#18234)
GitOrigin-RevId: 6c4aec482bb15f917219a01aec332de557f77ac8
2024-01-26 19:23:52 +00:00
nandinibhartiyaMDB
1599b6a993 SERVER-84463: Replace withOneStaleConfigRetry with shardVersionRetry (#18252)
(cherry picked from commit 34dccfb046c91c44a1622dfc054e4b1fdaa19d23)

GitOrigin-RevId: f214f89f9c1fdd01628d03cfa475d312b62e1691
2024-01-25 22:41:23 +00:00
huayu-ouyang
6218d7d526 SERVER-84594 Reduce load for sharding_uninitialized_fcv_jscore_passthrough and remove from unnecessary variants (#18022)
(cherry picked from commit aa4a4d5085e8b5be32b3c2a3fd070bee50ac73c3)

GitOrigin-RevId: 1f89772840da5a9cdf03e3d79bcffa78613e5084
2024-01-25 21:55:35 +00:00
Jack Mulrow
24bb5b3176 SERVER-85640 Ignore network errors from connect in run_check_metadata_consistency.js (#18309)
(cherry picked from commit ff4b1f69f770bc91d4f48a3b74296bf8dba041c3)

GitOrigin-RevId: 9547afd1c2b3f030f217949edb2e281ba83a2f34
2024-01-25 21:55:20 +00:00
Erin McNulty
7b7f3f53a0 SERVER-85628: Ensure that the client is removed from _clientByOperationId map before destruction (#18301)
(cherry picked from commit d2bf10e048dea8691b29cc7ecb4e52ab8fc46790)

GitOrigin-RevId: 053e0ce80d351bc198f439e7ab6692f721aacc7d
2024-01-25 21:05:00 +00:00
Zixuan
f146aeefe0 SERVER-85727 Revert "SERVER-83287 Avoid unnecessary next() call on unique indexes … (#18388)
GitOrigin-RevId: eacfd09bc2bca2abc0206dba154c23029fe08558
2024-01-25 21:04:43 +00:00
henrikedin
dcd0a915a6 SERVER-85714 BSONColumn validator needs to treat MinKey and MaxKey as uncompressed (#18379)
SERVER-85714 BSONColumn validator needs to treat MinKey and MaxKey as
uncompressed

(cherry picked from commit a9fce37a4317d1adf2921f4f2937f9e15ea43c4d)

GitOrigin-RevId: 99fa6139ef07cd0f19cbeb5d60716517d2fef676
2024-01-25 19:38:59 +00:00
Ian Boros
b5f16e5a7f SERVER-85644 Ensure TSBlock clone only copies decompressed data when present (#18340)
(cherry picked from commit 9122a9b9ee52b0566f61c26ffec5532b6649a43a)

GitOrigin-RevId: 38e180e7b9ff45b619caf07b94db4ec8f71efdba
2024-01-25 18:52:43 +00:00
roganamy
fc0f5edd08 SERVER-85652 : Update DSI atlas azure tasks to use an AL2 compile artifact. (#18369)
GitOrigin-RevId: 2d93dc53cfcde0b0bb72b270b806905e98410078
2024-01-25 14:37:51 +00:00
Etienne Petrel
a303024e09 SERVER-80041 Add a feature flag for autoCompact (#18250) (#18321)
GitOrigin-RevId: b1bda29447d3bd52b11f1b9ff838cf3675252e55
2024-01-25 05:09:05 +00:00
Zack Winter
749798bdb6 SERVER-85667 Disable Bazel Remote Execution on Public Releases (#18346) (#18358)
GitOrigin-RevId: 46defc225c999e47bc7791d11d443bd7ee86db5e
2024-01-25 01:00:43 +00:00
Jiawei Yang
d325c40bf1 SERVER-85635 mark prepared-txns-yield-locks thread unkillable (#18304)
GitOrigin-RevId: d56bf5cbe0087a3940d7e554d91ce280ab2ff42d
2024-01-25 00:09:19 +00:00
Peter Volk
d5c526e454 SERVER-85582 Update build variants configuration to exclude featureFlagSbeFull for forceClassic config (#18329)
GitOrigin-RevId: 43a4671649021e906da04ef08c5e5ba151b2cac0
2024-01-24 20:31:49 +00:00
Evelyn Wu
91b7d251e5 Revert "SERVER-82952 Add replication parameters to config fuzzer (#18235)"
This reverts commit bc014fe7ba9f182494de1fe2b0a6850d4fd544b1.

GitOrigin-RevId: e29487498e62940c1b7c315befce4d426b6e0e46
2024-01-24 17:27:35 +00:00
Henrik Edin
b17a9401cd Revert "SERVER-80290 Change a std::map with string keys to a StringMap. (#17780)"
This reverts commit ecb1c5958e7d4848458801da9447658feb602050.

GitOrigin-RevId: fccad8f470cbba7266b98fb6b28c406abe36361b
2024-01-24 15:15:49 +00:00
Jason Chan
9400762e5a SERVER-85594 Enable latches for missed build variants (#18280)
(cherry picked from commit 8af2e06d948051d9b7559bcd0a51d67c1b012cfa)

GitOrigin-RevId: 7c6ed9f94ab1774e014678db215c193471105236
2024-01-24 00:40:26 +00:00
Mikhail Shchatko
57b8ca60c8 SERVER-84500 Fix burn_in expansions
GitOrigin-RevId: cd9cdc8e9d02ebac5e36936614ed2beac810c92c
2024-01-24 00:40:11 +00:00
Mikhail Shchatko
60384e2aac SERVER-84500 Copy required variants from etc/evergreen.yml to etc/evergreen_nightly.yml
GitOrigin-RevId: c7b610c2ef59d2da7f107cc07d1741ce48a7a849
2024-01-24 00:39:56 +00:00
Mikhail Shchatko
3801f5b830 SERVER-84500 Remove the FCV sys-perf variants from etc/system_perf.yml
GitOrigin-RevId: d7a26d974b3a99f5b59eb87d41fb2fc0761a64bb
2024-01-24 00:39:41 +00:00
Mikhail Shchatko
910f913b41 SERVER-84500 Remove all feature flags variants from etc/system_perf.yml
GitOrigin-RevId: dfc7325f78e4d0d7a30a7bd56a0530645d9c3b9e
2024-01-24 00:39:27 +00:00
Mikhail Shchatko
84c7fc02b1 SERVER-84500 Remove renew_ssl_cert from etc/system_perf.yml
GitOrigin-RevId: 7f694781376d2640ef7d51fbd0e65ec71608038b
2024-01-24 00:39:12 +00:00
Mikhail Shchatko
4b78665df7 SERVER-84500 Change enterprise module branch name from "master" to "v7.3" in etc/system_perf.yml
GitOrigin-RevId: 38640e6e35aaad9069c2b81c180b98c76fcc4664
2024-01-24 00:38:57 +00:00
Mikhail Shchatko
72e7e54c29 SERVER-84500 Update filename suffixes in buildscripts/generate_version_expansions.py from "latest" to "v7.3-latest"
GitOrigin-RevId: 3590559b3277e240c5cba3ad57ef8d684420d2ce
2024-01-24 00:38:42 +00:00
Mikhail Shchatko
e287379c5f SERVER-84500 Change references from "master" to "v7.3" in etc/evergreen_yml_components/configuration.yml
GitOrigin-RevId: 7a975c2067ead3ea1bf6b00a497162d12ad7df30
2024-01-24 00:38:22 +00:00
Mikhail Shchatko
285f78a4b1 SERVER-84500 Change references from "master" to "v7.3" in etc/evergreen_yml_components/definitions.yml
GitOrigin-RevId: 8af4069d8d6ae15d54174738200a68af6c7b7c00
2024-01-24 00:37:55 +00:00
Mikhail Shchatko
e0dac58768 SERVER-84500 Change copybara references from "master" to "v7.3"
GitOrigin-RevId: 78e4c8d9b8f84985895ba9ee7b14b68841f2ea8d
2024-01-24 00:37:38 +00:00
1514 changed files with 133590 additions and 47830 deletions

View File

@ -52,6 +52,18 @@ build:local --experimental_remote_cache_compression=false
build:local --grpc_keepalive_time=0s
build:local --legacy_important_outputs
# Disable remote execution and caching for public releases
--config=public-release
build:public-release --remote_executor=
build:public-release --remote_cache=
build:public-release --bes_backend=
build:public-release --bes_results_url=
build:public-release --tls_client_certificate=
build:public-release --tls_client_key=
build:public-release --experimental_remote_cache_compression=false
build:public-release --grpc_keepalive_time=0s
build:public-release --legacy_important_outputs
# try to import the bazelrc files if available
try-import %workspace%/.bazelrc.local

View File

@ -17,6 +17,7 @@ rules:
no-redeclare: 0
no-constant-condition: 0
no-loss-of-precision: 0
semi: 2
no-restricted-syntax: [
'error',
{

View File

@ -1,6 +1,6 @@
# ![Logo](docs/leaf.svg) MongoDB README
Welcome to MongoDB!
Welcome to MongoDB 7.3!
## Components
@ -91,5 +91,6 @@ Welcome to MongoDB!
October 16, 2018 are published under the AGPL. All versions released after
October 16, 2018, including patch fixes for prior versions, are published
under the [Server Side Public License (SSPL) v1](LICENSE-Community.txt).
See individual files for details.
See individual files for details which will specify the license applicable
to each file. Files subject to the SSPL will be noted in their headers.

View File

@ -52,7 +52,7 @@ a notice will be included in
| [schemastore.org] | Apache-2.0 | 6847cfc3a1 | | |
| [scons] | MIT | 3.1.2 | | |
| [Snappy] | BSD-3-Clause | 1.1.7 | ✗ | ✗ |
| [timelib] | MIT | 2022.04 | | ✗ |
| [timelib] | MIT | 2022.10 | | ✗ |
| [TomCrypt] | Public Domain | 1.18.2 | ✗ | ✗ |
| [Unicode] | Unicode-DFS-2015 | 8.0.0 | ✗ | ✗ |
| [libunwind] | MIT | 1.6.2 + changes | | ✗ |
@ -62,6 +62,7 @@ a notice will be included in
| [Zlib] | Zlib | 1.3 | ✗ | ✗ |
| [Zstandard] | BSD-3-Clause | 1.5.5 | ✗ | ✗ |
[abseil-cpp]: https://github.com/abseil/abseil-cpp
[ASIO]: https://github.com/chriskohlhoff/asio
[benchmark]: https://github.com/google/benchmark

View File

@ -5102,10 +5102,9 @@ def doConfigure(myenv):
if use_system_version_of_library("libunwind"):
conf.FindSysLibDep("unwind", ["unwind"])
if use_libunwind:
if not conf.FindSysLibDep("lzma", ["lzma"]):
myenv.ConfError("Cannot find system library 'lzma' required for use with libunwind")
myenv.ConfError(
"Cannot find system library 'lzma' required for use with system libunwind")
if use_system_version_of_library("intel_decimal128"):
conf.FindSysLibDep("intel_decimal128", ["bid"])
@ -5995,6 +5994,18 @@ env.AddPackageNameAlias(
name="mongodb-cryptd-debugsymbols",
)
env.AddPackageNameAlias(
component="benchmarks",
role="runtime",
name="benchmarks",
)
env.AddPackageNameAlias(
component="benchmarks",
role="debug",
name="benchmarks-debugsymbols",
)
env.AddPackageNameAlias(
component="mh",
role="runtime",
@ -6021,6 +6032,13 @@ env.AutoInstall(
AIB_COMPONENTS_EXTRA=['dist-test'],
)
env.AutoInstall(
".",
"$BENCHMARK_LIST",
AIB_COMPONENT="benchmarks",
AIB_ROLE='runtime',
)
env['RPATH_ESCAPED_DOLLAR_ORIGIN'] = '\\$$$$ORIGIN'
@ -6570,11 +6588,22 @@ env.FinalizeInstallDependencies()
# Create a install-all-meta alias that excludes unittests. This is most useful in
# static builds where the resource requirements of linking 100s of static unittest
# binaries is prohibitive.
candidate_nodes = set([
str(gchild) for gchild in env.Flatten(
[child.all_children() for child in env.Alias('install-all-meta')[0].all_children()])
])
names = [f'install-{env["AIB_META_COMPONENT"]}', 'install-tests', env["UNITTEST_ALIAS"]]
candidate_nodes = set()
for child in env.Alias('install-all-meta')[0].all_children():
candidate_nodes.add(child)
for gchild in child.all_children():
candidate_nodes.add(gchild)
names = [
f'install-{env["AIB_META_COMPONENT"]}',
'install-tests',
env["UNITTEST_ALIAS"],
'install-first-quarter-unittests',
'install-second-quarter-unittests',
'install-third-quarter-unittests',
'install-fourth-quarter-unittests',
]
env.Alias('install-all-meta-but-not-unittests', [
node for node in candidate_nodes if str(node) not in names
and not str(node).startswith(tuple([prefix_name + '-' for prefix_name in names]))

View File

@ -41,7 +41,7 @@ EXTERNAL_LOGGERS = {
"urllib3",
}
DEFAULT_VARIANT = "enterprise-rhel-80-64-bit-dynamic-all-feature-flags-required"
DEFAULT_VARIANT = "enterprise-rhel-8-64-bit-dynamic-all-feature-flags-required"
ENTERPRISE_MODULE_PATH = "src/mongo/db/modules/enterprise"
DEFAULT_REPO_LOCATIONS = [".", f"./{ENTERPRISE_MODULE_PATH}"]
REPEAT_SUITES = 2

View File

@ -183,7 +183,7 @@ def main():
else:
if platform.machine() == 'x86_64':
variant = BuildVariant(
name="enterprise-rhel-80-64-bit-build-metrics",
name="enterprise-rhel-8-64-bit-build-metrics",
activate=True,
)
for link_model, tasks in tasks['linux_x86_64_tasks'].items():
@ -191,7 +191,7 @@ def main():
create_task_group(f'linux_X86_64_{link_model}', tasks), ['rhel80-xlarge'])
else:
variant = BuildVariant(
name="enterprise-rhel-80-aarch64-build-metrics",
name="enterprise-rhel-8-aarch64-build-metrics",
activate=True,
)
for link_model, tasks in tasks['linux_arm64_tasks'].items():

View File

@ -30,11 +30,12 @@ SYS_PLATFORM = sys.platform
# Apply factor for a task based on the build variant it is running on.
VARIANT_TASK_FACTOR_OVERRIDES = {
"enterprise-rhel-80-64-bit": [{"task": r"logical_session_cache_replication.*", "factor": 0.75}],
"enterprise-rhel-80-64-bit-inmem": [
"enterprise-rhel-8-64-bit": [{"task": r"logical_session_cache_replication.*", "factor": 0.75}],
"enterprise-rhel-8-64-bit-inmem": [
{"task": "secondary_reads_passthrough", "factor": 0.3},
{"task": "multi_stmt_txn_jscore_passthrough_with_migration", "factor": 0.3},
]
],
"enterprise-suse12-64": [{"task": "replica_sets_auth", "factor": 0.5}],
}
TASKS_FACTORS = [{"task": r"replica_sets.*", "factor": 0.5}, {"task": r"sharding.*", "factor": 0.5}]

View File

@ -61,8 +61,8 @@ def generate_version_expansions():
raise ValueError("Unable to parse version from stdin and no version.json provided")
if version_parts[0]:
expansions["suffix"] = "latest"
expansions["src_suffix"] = "latest"
expansions["suffix"] = "v7.3-latest"
expansions["src_suffix"] = "v7.3-latest"
expansions["is_release"] = "false"
else:
expansions["suffix"] = version_line

View File

@ -339,6 +339,39 @@ ALLOWED_NEW_COMPLEX_ACCESS_CHECKS = dict(
complexChecksSupersetSomeAllowed={'checkTwo'})
@dataclass
class AllowedNewPrivilege:
"""Represents a privilege check that should be ignored by the API compatibility checker."""
resource_pattern: str
action_type: List[str]
agg_stage: Optional[str] = None
@classmethod
def create_from(cls, privilege: syntax.Privilege):
return cls(privilege.resource_pattern, privilege.action_type, privilege.agg_stage)
ALLOWED_NEW_ACCESS_CHECK_PRIVILEGES = dict(
# Do not add any command other than the aggregate command or any privilege that is not required
# only by an aggregation stage not present in previously released versions.
aggregate=[
# TODO SERVER-87193: Check if we can remove the line below after the next 7.0 patch release (7.0.7) is out.
# The feature using 'queryStatsReadTransformed' has been backported to v7.0 but is not present
# in the latest patch release. It is guarded by a feature flag so we are allowing this conflict here.
AllowedNewPrivilege("cluster", ["queryStatsReadTransformed"], "queryStats"),
],
# This list is only used in unit-tests.
complexChecksSupersetAllowed=[
AllowedNewPrivilege("resourcePatternTwo", ["actionTypeTwo"]),
AllowedNewPrivilege("resourcePatternThree", ["actionTypeThree"]),
],
complexCheckPrivilegesSupersetSomeAllowed=[
AllowedNewPrivilege("resourcePatternTwo", ["actionTypeTwo"])
])
class FieldCompatibility:
"""Information about a Field to check compatibility."""
@ -1357,6 +1390,12 @@ def check_complex_checks(ctxt: IDLCompatibilityContext,
if check in new_checks_normalized:
new_checks_normalized.remove(check)
if cmd_name in ALLOWED_NEW_ACCESS_CHECK_PRIVILEGES:
new_privileges = [
privilege for privilege in new_privileges if AllowedNewPrivilege.create_from(privilege)
not in ALLOWED_NEW_ACCESS_CHECK_PRIVILEGES[cmd_name]
]
if (len(new_checks_normalized) + len(new_privileges)) > (
len(old_checks_normalized) + len(old_privileges)):
ctxt.add_new_additional_complex_access_check_error(cmd_name, new_idl_file_path)

View File

@ -2762,6 +2762,45 @@ commands:
- check: checkOne
- check: checkTwo
complexCheckPrivilegesSupersetNoneAllowed:
description: "new command fails when privileges in the access check are a superset of the old
privileges and none of the additional privileges are explicitly allowed."
command_name: complexCheckPrivilegesSupersetNoneAllowed
namespace: ignored
cpp_name: complexCheckPrivilegesSupersetNoneAllowed
strict: true
api_version: "1"
reply_type: OkReply
access_check:
complex:
- privilege:
resource_pattern: resourcePatternOne
action_type: [actionTypeOne]
- privilege:
resource_pattern: resourcePatternTwo
action_type: [actionTypeTwo]
complexCheckPrivilegesSupersetSomeAllowed:
description: "new command fails when privileges in the access check are a superset of the old
privileges and not all of the additional privileges are explicitly allowed."
command_name: complexCheckPrivilegesSupersetSomeAllowed
namespace: ignored
cpp_name: complexCheckPrivilegesSupersetSomeAllowed
strict: true
api_version: "1"
reply_type: OkReply
access_check:
complex:
- privilege:
resource_pattern: resourcePatternOne
action_type: [actionTypeOne]
- privilege:
resource_pattern: resourcePatternTwo
action_type: [actionTypeTwo]
- privilege:
resource_pattern: resourcePatternThree
action_type: [actionTypeThree]
complexChecksSupersetNoneAllowed:
description: "new command fails when the the complex checks are a superset of the old
checks and none of the additional checks are explicitly allowed."

View File

@ -2810,6 +2810,36 @@ commands:
- check: checkOne
- check: checkTwo
complexCheckPrivilegesSupersetNoneAllowed:
description: "new command fails when privileges in the access check are a superset of the old
privileges and none of the additional privileges are explicitly allowed."
command_name: complexCheckPrivilegesSupersetNoneAllowed
namespace: ignored
cpp_name: complexCheckPrivilegesSupersetNoneAllowed
strict: true
api_version: "1"
reply_type: OkReply
access_check:
complex:
- privilege:
resource_pattern: resourcePatternOne
action_type: [actionTypeOne]
complexCheckPrivilegesSupersetSomeAllowed:
description: "new command fails when privileges in the access check are a superset of the old
privileges and not all of the additional privileges are explicitly allowed."
command_name: complexCheckPrivilegesSupersetSomeAllowed
namespace: ignored
cpp_name: complexCheckPrivilegesSupersetSomeAllowed
strict: true
api_version: "1"
reply_type: OkReply
access_check:
complex:
- privilege:
resource_pattern: resourcePatternOne
action_type: [actionTypeOne]
complexChecksSupersetNoneAllowed:
description: "new command fails when the the complex checks are a superset of the old
checks and none of the additional checks are explicitly allowed."

View File

@ -1967,6 +1967,15 @@ commands:
- check: checkOne
- check: checkTwo
- check: checkThree
- privilege:
resource_pattern: resourcePatternOne
action_type: [actionTypeOne]
- privilege:
resource_pattern: resourcePatternTwo
action_type: [actionTypeTwo]
- privilege:
resource_pattern: resourcePatternThree
action_type: [actionTypeThree]
addedAggStage:
description: "new command passes when a agg stage is added"

View File

@ -1914,6 +1914,9 @@ commands:
access_check:
complex:
- check: checkOne
- privilege:
resource_pattern: resourcePatternOne
action_type: [actionTypeOne]
addedAggStage:
description: "new command passes when a agg stage is added"

View File

@ -1287,6 +1287,22 @@ class TestIDLCompatibilityChecker(unittest.TestCase):
idl_compatibility_errors.ERROR_ID_NEW_ADDITIONAL_COMPLEX_ACCESS_CHECK)
self.assertRegex(str(complex_checks_not_subset_two_error), "complexChecksNotSubsetTwo")
complex_check_privileges_superset_none_allowed_error = error_collection.get_error_by_command_name(
"complexCheckPrivilegesSupersetNoneAllowed")
self.assertTrue(complex_check_privileges_superset_none_allowed_error.error_id ==
idl_compatibility_errors.ERROR_ID_NEW_ADDITIONAL_COMPLEX_ACCESS_CHECK)
self.assertRegex(
str(complex_check_privileges_superset_none_allowed_error),
"complexCheckPrivilegesSupersetNoneAllowed")
complex_check_privileges_superset_some_allowed_error = error_collection.get_error_by_command_name(
"complexCheckPrivilegesSupersetSomeAllowed")
self.assertTrue(complex_check_privileges_superset_some_allowed_error.error_id ==
idl_compatibility_errors.ERROR_ID_NEW_ADDITIONAL_COMPLEX_ACCESS_CHECK)
self.assertRegex(
str(complex_check_privileges_superset_some_allowed_error),
"complexCheckPrivilegesSupersetSomeAllowed")
complex_checks_superset_none_allowed_error = error_collection.get_error_by_command_name(
"complexChecksSupersetNoneAllowed")
self.assertTrue(complex_checks_superset_none_allowed_error.error_id ==
@ -1510,7 +1526,7 @@ class TestIDLCompatibilityChecker(unittest.TestCase):
self.assertRegex(
str(new_command_type_field_added_as_stable_error), "newStableTypeFieldAdded")
self.assertEqual(error_collection.count(), 213)
self.assertEqual(error_collection.count(), 215)
def test_generic_argument_compatibility_pass(self):
"""Tests that compatible old and new generic_argument.idl files should pass."""

View File

@ -342,8 +342,18 @@ def get_tools_package(arch_name: str, os_name: str) -> Optional[str]:
if arch_name == "aarch64" and not os_name.startswith("amazon") and not os_name.startswith(
"rhel"):
arch_name = "arm64"
# Tools packages are only published to the latest RHEL version supported on master, but
# the tools binaries are cross compatible with other RHEL versions
# (see https://jira.mongodb.org/browse/SERVER-92939)
def major_version_matches(download_name: str) -> bool:
if (os_name.startswith("rhel") and download_name.startswith("rhel")
and os_name[4] == download_name[4]):
return True
return download_name == os_name
for download in current_tools_releases["versions"][0]["downloads"]:
if download["name"] == os_name and download["arch"] == arch_name:
if major_version_matches(download["name"]) and download["arch"] == arch_name:
return download["package"]["url"]
return None

View File

@ -4,6 +4,7 @@
# pylint: disable=redefined-outer-name,invalid-name,subprocess-run-check
import grp
import json
import logging
import os
import pathlib
@ -71,8 +72,9 @@ def download_extract_package(package: str) -> List[str]:
def download_extract_all_packages(package_urls: List[str]) -> List[str]:
all_packages = [] # type: List[str]
for package_url in package_urls:
package_names = download_extract_package(package_url)
all_packages.extend(["./" + package_name for package_name in package_names])
if package_url:
package_names = download_extract_package(package_url)
all_packages.extend(["./" + package_name for package_name in package_names])
return all_packages
@ -354,10 +356,13 @@ def test_install_is_complete(test_args: TestArgs):
raise RuntimeError("Required group `{}' is not in configured groups: {}".format(
test_args['mongo_groupname'], mongo_user_groups))
if user_info.pw_dir != test_args['mongo_home_dir']:
raise RuntimeError(
"Configured home directory `{}' does not match required path `{}'".format(
user_info.pw_dir, test_args['mongo_home_dir']))
if test_args['package_manager'] in ('yum', 'zypper'):
# Only RPM-based distros create the home directory. Debian/Ubuntu
# distros use a non-existent directory in /home
if user_info.pw_dir != test_args['mongo_home_dir']:
raise RuntimeError(
"Configured home directory `{}' does not match required path `{}'".format(
user_info.pw_dir, test_args['mongo_home_dir']))
if user_info.pw_shell != test_args['mongo_user_shell']:
raise RuntimeError("Configured user shell `{}' does not match required path `{}'".format(
@ -414,6 +419,13 @@ def test_stop():
def test_install_compass(test_args: TestArgs):
if test_args['arch'] != "x86_64" or test_args['os_name'] not in ["ubuntu", "almalinux"]:
logging.info(
"Not installing compass on unsupported platform, see the docs: https://www.mongodb.com/docs/compass/current/install/"
)
return
logging.info("Installing Compass.")
cmd = [] # type: List[str]
@ -421,15 +433,7 @@ def test_install_compass(test_args: TestArgs):
cmd += ["DEBIAN_FRONTEND=noninteractive"]
cmd += ["install_compass"]
exec_result = run_and_log(" ".join(cmd), end_on_error=False)
# install-compass currently cannot use zypper to install packages. Ignore error code.
if test_args['package_manager'] == 'zypper' or exec_result.returncode not in [
0, # success
3, # unsupported arch (compass only supports x86_64)
6, # unsupported linux version
]:
raise RuntimeError("Failed to install compass")
run_and_log(" ".join(cmd))
def test_uninstall(test_args: TestArgs):
@ -489,6 +493,7 @@ else:
sys.exit(1)
test_args = get_test_args(package_manager, package_files)
logging.info("Test Args:\n%s", json.dumps(test_args, sort_keys=True, indent=4))
setup(test_args)
install_fake_systemd(test_args)

View File

@ -15,3 +15,4 @@
- featureFlagGRPC
- featureFlagReplicaSetEndpoint
- featureFlagClassicRuntimePlanningForSbe
- featureFlagCreateCollectionInPreparedTransactions

View File

@ -0,0 +1,27 @@
logging:
executor:
format: '[%(name)s] %(asctime)s %(message)s'
handlers:
- class: logging.StreamHandler
fixture:
format: '[%(name)s] %(message)s'
handlers:
- class: evergreen
tests:
format: '[%(name)s] %(message)s'
handlers:
- class: evergreen
shorten_logger_name:
remove:
- MongoDFixture
- ReplicaSetFixture
- ShardedClusterFixture
replace:
primary: prim
secondary: sec
node: n
shard: s
configsvr: c
mongos: s
job: j

View File

@ -68,7 +68,6 @@ selector:
- jstests/core/json_schema/json_schema.js
- jstests/core/**/mr_bigobject.js
- jstests/core/**/not2.js
- jstests/core/**/notablescan.js
- jstests/core/**/null_query_semantics.js
- jstests/core/**/or1.js
- jstests/core/**/or2.js

View File

@ -42,6 +42,11 @@ executor:
num_shards: 2
old_bin_version: last_continuous
hooks:
- class: CheckRoutingTableConsistency
shell_options:
global_vars:
TestData:
mayForgeReshardingTempCollections: true
- class: FuzzerRestoreSettings
- class: CheckReplDBHash
shell_options:

View File

@ -42,6 +42,11 @@ executor:
num_shards: 2
old_bin_version: last_lts
hooks:
- class: CheckRoutingTableConsistency
shell_options:
global_vars:
TestData:
mayForgeReshardingTempCollections: true
- class: FuzzerRestoreSettings
- class: CheckReplDBHash
shell_options:

View File

@ -321,6 +321,11 @@
value:
executor:
hooks:
- class: CheckRoutingTableConsistency
shell_options:
global_vars:
TestData:
mayForgeReshardingTempCollections: true
- class: FuzzerRestoreSettings
- class: CheckReplDBHash
shell_options:

View File

@ -110,24 +110,24 @@ evergreen_buildvariants:
platform: rhel70
architecture: x86_64
- name: rhel80
- name: rhel8
edition: targeted
platform: rhel80
platform: rhel8
architecture: x86_64
- name: enterprise-rhel-80-64-bit
- name: enterprise-rhel-8-64-bit
edition: enterprise
platform: rhel80
platform: rhel8
architecture: x86_64
- name: rhel-82-arm64
- name: rhel8-arm64
edition: targeted
platform: rhel82
platform: rhel8
architecture: arm64
- name: enterprise-rhel-82-arm64
- name: enterprise-rhel8-arm64
edition: enterprise
platform: rhel82
platform: rhel8
architecture: arm64
- name: enterprise-rhel-71-ppc64le

View File

@ -27,6 +27,11 @@ selector:
- jstests/concurrency/fsm_workloads/multi_statement_transaction_simple_kill_sessions.js
- jstests/concurrency/fsm_workloads/multi_statement_transaction_simple_read_write_kill_sessions.js
# This suite has TestData.discoveryTopology: False so clusterOptions.replication.enabled doesn't
# get set true. analyze_shard_key.js calls cluster.awaitReplication() which has an
# isReplication() check. So it is expected to fail every time it gets run in this suite.
- jstests/concurrency/fsm_workloads/analyze_shard_key.js
exclude_with_any_tags:
# Workloads that use a write concern will fail since the workload only connects to the primary.
- uses_write_concern

View File

@ -204,6 +204,9 @@ executor:
queryAnalysisWriterIntervalSecs: 1
defaultConfigCommandTimeoutMS: 90000
skipDroppingHashedShardKeyIndex: true
# Delay orphan cleanup to get around SERVER-87673.
# Choose a setting lower than continuous stepdown interval to get around SERVER-90242.
orphanCleanupDelaySecs: 5
num_rs_nodes_per_shard: 3
num_shards: 2
num_mongos: 2

View File

@ -200,6 +200,9 @@ executor:
queryAnalysisWriterIntervalSecs: 1
defaultConfigCommandTimeoutMS: 90000
skipDroppingHashedShardKeyIndex: true
# Delay orphan cleanup to get around SERVER-87673.
# Choose a setting lower than continuous stepdown interval to get around SERVER-90242.
orphanCleanupDelaySecs: 5
num_rs_nodes_per_shard: 3
num_shards: 2
num_mongos: 2

View File

@ -309,7 +309,6 @@ selector:
- jstests/core/**/not1.js
- jstests/core/**/not2.js
- jstests/core/**/not3.js
- jstests/core/**/notablescan.js
- jstests/core/**/null_query_semantics.js
- jstests/core/**/null_query_semantics.js
- jstests/core/**/objectfind.js

View File

@ -6,8 +6,11 @@ test_kind: js_test
selector:
roots:
- jstests/core/**/*.js
- jstests/core/**/*.js
exclude_files:
# This test attempts to read from the "local.oplog.rs" collection, which may be missing entries
# if a write was performed on the primary of the replica set instead.
- jstests/core/query/awaitdata_getmore_cmd.js
exclude_with_any_tags:
- assumes_standalone_mongod

View File

@ -97,6 +97,10 @@ selector:
# of commands. If they profile the setFCV command, this could cause the test to fail.
- jstests/core/administrative/profile/profile_sampling.js
- jstests/core/administrative/profile/profile1.js
- jstests/aggregation/sources/lookup/profile_lookup.js
# SERVER-85456: this test uses benchRun which does not use runCommand and index creation can fail
- jstests/core/bench_test1.js
executor:
archive:

View File

@ -103,6 +103,12 @@ selector:
- jstests/aggregation/sources/facet/facet_stats.js
- jstests/aggregation/sources/unionWith/unionWith_query_stats.js
# Test runs an updateOne without shard key which will use an internal transaction
# that can be aborted by the fcv upgrade downgrade suite.
- jstests/core/command_let_variables_expressions.js
- jstests/core/index/hashed/hashed_index_with_arrays.js
- jstests/core/write/update/update_with_pipeline.js
# Expected failure due to interfering collMod commands acquiring a lock that the test does not expect.
- jstests/core/write/crud_ops_do_not_throw_locktimeout.js
@ -145,6 +151,9 @@ selector:
# setFCV operations. The exclusion can be removed once the linked ticket is fixed.
- jstests/core/top.js
# SERVER-85456: this test uses benchRun which does not use runCommand and index creation can fail
- jstests/core/bench_test1.js
exclude_with_any_tags:
- assumes_standalone_mongod
- assumes_against_mongod_not_mongos

View File

@ -105,6 +105,9 @@ selector:
# setFCV operations. The exclusion can be removed once the linked ticket is fixed.
- jstests/core/top.js
# SERVER-85456: this test uses benchRun which does not use runCommand and index creation can fail
- jstests/core/bench_test1.js
exclude_with_any_tags:
- assumes_standalone_mongod
- assumes_against_mongod_not_mongos

View File

@ -34,6 +34,10 @@ executor:
TestData:
skipValidationOnInvalidViewDefinitions: true
- class: CheckRoutingTableConsistency
shell_options:
global_vars:
TestData:
mayForgeReshardingTempCollections: true
fixture:
class: ShardedClusterFixture
mongos_options:

View File

@ -32,6 +32,10 @@ executor:
TestData:
skipValidationOnInvalidViewDefinitions: true
- class: CheckRoutingTableConsistency
shell_options:
global_vars:
TestData:
mayForgeReshardingTempCollections: true
fixture:
class: ShardedClusterFixture
mongos_options:

View File

@ -38,6 +38,10 @@ executor:
TestData:
skipValidationOnInvalidViewDefinitions: true
- class: CheckRoutingTableConsistency
shell_options:
global_vars:
TestData:
mayForgeReshardingTempCollections: true
fixture:
class: ShardedClusterFixture
mongos_options:

View File

@ -29,6 +29,10 @@ executor:
TestData:
skipValidationOnInvalidViewDefinitions: true
- class: CheckRoutingTableConsistency
shell_options:
global_vars:
TestData:
mayForgeReshardingTempCollections: true
fixture:
class: ShardedClusterFixture
mongos_options:

View File

@ -39,7 +39,7 @@ selector:
# collection.getPlanCache().* calls planCache* commands which are not allowed with security token.
- jstests/core/**/cached_plan_trial_does_not_discard_work.js
- jstests/core/**/collation_plan_cache.js
- jstests/core/**/explode_for_sort_plan_cache.js
- jstests/core/**/in_expression_plan_cache.js
- jstests/core/**/index_filter_commands.js
- jstests/core/**/index_filter_commands_invalidate_plan_cache_entries.js
- jstests/core/**/introspect_hidden_index_plan_cache_entries.js

View File

@ -41,7 +41,6 @@ selector:
- jstests/core/json_schema/json_schema.js
- jstests/core/**/mr_bigobject.js
- jstests/core/**/not2.js
- jstests/core/**/notablescan.js
- jstests/core/**/null_query_semantics.js
- jstests/core/**/or1.js
- jstests/core/**/or2.js

View File

@ -3,6 +3,8 @@ test_kind: js_test
selector:
roots:
- src/mongo/db/modules/*/jstests/sasl/*.js
exclude_files:
- src/mongo/db/modules/enterprise/jstests/sasl/sasl_plugins.js
# sasl tests start their own mongod's.
executor:

View File

@ -0,0 +1,11 @@
test_kind: js_test
selector:
roots:
- src/mongo/db/modules/*/jstests/sasl/sasl_plugins.js
# sasl tests start their own mongod's.
executor:
config:
shell_options:
nodb: ""

View File

@ -30,6 +30,12 @@ selector:
- jstests/core/**/crud_api.js
- jstests/core/**/batch_write_command_w0.js
# These tests insert an uncompressed time-series bucket. Even though the tests subsequently remove
# this bucket, it may end up not being removed on the donor. If this happens, collection
# validation will fail due to the uncompressed bucket.
- jstests/core/timeseries/timeseries_insert_mixed_schema_bucket.js
- jstests/core/timeseries/timeseries_update_mixed_schema_bucket.js
exclude_with_any_tags:
- assumes_standalone_mongod
# These tests run getMore commands which are not supported in the tenant migration passthrough.

View File

@ -17,7 +17,15 @@ selector:
# Skip any tests that run with auth explicitly.
- jstests/core/administrative/*[aA]uth*.js
# These tests insert an uncompressed time-series bucket. Even though the tests subsequently remove
# this bucket, it may end up not being removed on the donor. If this happens, collection
# validation will fail due to the uncompressed bucket.
- jstests/core/timeseries/timeseries_insert_mixed_schema_bucket.js
- jstests/core/timeseries/timeseries_update_mixed_schema_bucket.js
exclude_with_any_tags:
- incompatible_with_shard_merge
- assumes_standalone_mongod
# These tests run getMore commands which are not supported in the tenant migration passthrough.
- requires_getmore

View File

@ -0,0 +1,83 @@
test_kind: js_test
selector:
roots:
- jstests/core/txns/**/*.js
exclude_files:
### Tests that are excluded because of sharding and transactions (from sharded_jscore_txns_sharded_collections.yml)
# Profile can only be run against the admin database on mongos.
- jstests/core/txns/transactions_profiling.js
- jstests/core/txns/transactions_profiling_with_drops.js
# Implicitly creates a database through a collection rename, which does not work in a sharded
# cluster.
- jstests/core/txns/transactions_block_ddl.js
# transactionLifetimeLimitSeconds parameter is not available in mongos.
- jstests/core/txns/abort_expired_transaction.js
- jstests/core/txns/abort_transaction_thread_does_not_block_on_locks.js
- jstests/core/txns/kill_op_on_txn_expiry.js
# Uses hangAfterCollectionInserts failpoint not available on mongos.
- jstests/core/txns/speculative_snapshot_includes_all_writes.js
# View tests aren't expected to work when collections are implicitly sharded.
- jstests/core/txns/view_reads_in_transaction.js
# These workloads explicitly create collections inside multi-document transactions. These are
# non-idempotent operations, and the implicit collection sharding logic upon collection access
# results in premature collection creation, causing the workloads to fail.
- jstests/core/txns/create_collection.js
- jstests/core/txns/create_collection_parallel.js
- jstests/core/txns/create_indexes.js
- jstests/core/txns/create_indexes_parallel.js
- jstests/core/txns/commands_in_txns_read_concern.js
exclude_with_any_tags:
- assumes_against_mongod_not_mongos
# This passthrough implicitly shards the accessed collections. Do not run tests where collections
# can't be created on `getCollection` call.
- assumes_no_implicit_collection_creation_on_get_collection
# Tests tagged with the following will fail because they assume collections are not sharded.
- assumes_no_implicit_collection_creation_after_drop
- assumes_no_implicit_index_creation
- assumes_unsharded_collection
- cannot_create_unique_index_when_using_hashed_shard_key
# Transactions are not allowed to operate on capped collections.
- requires_capped
# Prepare is not a command on mongos.
- uses_prepare_transaction
executor:
config:
shell_options:
eval: >-
globalThis.testingReplication = true;
await import('jstests/libs/override_methods/send_command_to_initial_sync_node.js');
await import("jstests/libs/override_methods/implicitly_shard_accessed_collections.js");
fixture:
class: ShardedClusterFixture
mongos_options:
set_parameters:
enableTestCommands: 1
mongod_options:
set_parameters:
enableTestCommands: 1
collectionClonerBatchSize: 10
initialSyncOplogFetcherBatchSize: 10
num_shards: 2
num_rs_nodes_per_shard: 2
shard_options:
start_initial_sync_node: True
initial_sync_uninitialized_fcv: True
# The ReplicaSetFixture automatically sets initial sync nodes as hidden,
# which causes a mismatch when the replica set is added to the sharded cluster
# through addShard, because the replica set's internal connection string does
# include the initial sync node, but the list of hosts in the replica set from
# running `hello`/`isMaster` does not include it. This parameter force-hides it
# from the connection string.
hide_initial_sync_node_from_conn_string: True
configsvr_options:
num_nodes: 2
start_initial_sync_node: True
initial_sync_uninitialized_fcv: True
hide_initial_sync_node_from_conn_string: True

View File

@ -6,6 +6,9 @@ selector:
- jstests/fle2/**/*.js
- src/mongo/db/modules/*/jstests/fle2/**/*.js
exclude_files:
# These tests run in the sharded_collections_txns_uninitialized_fcv passthrough suite.
- jstests/core/txns/**/*.js
### Tests that are excluded because of initial sync (from replica_sets_initsync_jscore_passthrough.yml)
# Tests that query the system.profile collection cannot run in this suite since an initial sync
# may insert unexpected operations into the profile collection.
@ -94,37 +97,10 @@ selector:
- jstests/core/**/optimized_match_explain.js
- jstests/core/**/sort_array.js
### Tests that are excluded because of sharding and transactions (from sharded_jscore_txns_sharded_collections.yml)
# Profile can only be run against the admin database on mongos.
- jstests/core/txns/transactions_profiling.js
- jstests/core/txns/transactions_profiling_with_drops.js
# Implicitly creates a database through a collection rename, which does not work in a sharded
# cluster.
- jstests/core/txns/transactions_block_ddl.js
# transactionLifetimeLimitSeconds parameter is not available in mongos.
- jstests/core/txns/abort_expired_transaction.js
- jstests/core/txns/abort_transaction_thread_does_not_block_on_locks.js
- jstests/core/txns/kill_op_on_txn_expiry.js
# Uses hangAfterCollectionInserts failpoint not available on mongos.
- jstests/core/txns/speculative_snapshot_includes_all_writes.js
# View tests aren't expected to work when collections are implicitly sharded.
- jstests/core/txns/view_reads_in_transaction.js
# These workloads explicitly create collections inside multi-document transactions. These are
# non-idempotent operations, and the implicit collection sharding logic upon collection access
# results in premature collection creation, causing the workloads to fail.
- jstests/core/txns/create_collection.js
- jstests/core/txns/create_collection_parallel.js
- jstests/core/txns/create_indexes.js
- jstests/core/txns/create_indexes_parallel.js
- jstests/core/txns/commands_in_txns_read_concern.js
# Will fail all commands including those needed to forward command to initial sync node.
- jstests/core/failcommand_failpoint.js
# Has asserts that depend on the use of fsyncLock which is skipped by this passthrough.
- jstests/core/ddl/killop_drop_collection.js
exclude_with_any_tags:
- assumes_standalone_mongod

View File

@ -104,6 +104,7 @@ selector:
- jstests/sharding/move_chunk_insert_with_write_retryability.js
- jstests/sharding/move_chunk_remove_with_write_retryability.js
- jstests/sharding/move_chunk_update_with_write_retryability.js
- jstests/sharding/multi_collection_transaction_placement_conflict_workaround.js # sets a failpoint on the config primary
- jstests/sharding/refine_collection_shard_key_atomic.js # sets a failpoint on the config primary
- jstests/sharding/restart_transactions.js
- jstests/sharding/txn_two_phase_commit_commands_basic_requirements.js
@ -251,6 +252,8 @@ selector:
# Test runs command on a config shard and does not shutdown safely upon transitioning to a dedicated config server.
- jstests/sharding/fsync_lock_unlock.js
- jstests/sharding/fsync_with_prepared_transaction.js
- jstests/sharding/fsync_lock_fails_with_in_progress_ddl_op.js
# Expect the configureQueryAnalyzer command to execute without config server stepdown.
- jstests/sharding/analyze_shard_key/configure_query_analyzer_persistence.js

View File

@ -0,0 +1,60 @@
test_kind: js_test
selector:
roots:
- jstests/core/txns/**/*.js
exclude_files:
# Profile can only be run against the admin database on mongos.
- jstests/core/txns/transactions_profiling.js
- jstests/core/txns/transactions_profiling_with_drops.js
# Implicitly creates a database through a collection rename, which does not work in a sharded
# cluster.
- jstests/core/txns/transactions_block_ddl.js
# transactionLifetimeLimitSeconds parameter is not available in mongos.
- jstests/core/txns/abort_expired_transaction.js
- jstests/core/txns/abort_transaction_thread_does_not_block_on_locks.js
- jstests/core/txns/kill_op_on_txn_expiry.js
# Uses hangAfterCollectionInserts failpoint not available on mongos.
- jstests/core/txns/speculative_snapshot_includes_all_writes.js
exclude_with_any_tags:
- assumes_against_mongod_not_mongos
# Transactions are not allowed to operate on capped collections.
- requires_capped
# Prepare is not a command on mongos.
- uses_prepare_transaction
executor:
config:
shell_options:
eval: >-
globalThis.testingReplication = true;
await import('jstests/libs/override_methods/send_command_to_initial_sync_node.js');
fixture:
class: ShardedClusterFixture
mongos_options:
set_parameters:
enableTestCommands: 1
mongod_options:
set_parameters:
enableTestCommands: 1
collectionClonerBatchSize: 10
initialSyncOplogFetcherBatchSize: 10
num_shards: 1
num_rs_nodes_per_shard: 2
shard_options:
start_initial_sync_node: True
initial_sync_uninitialized_fcv: True
# The ReplicaSetFixture automatically sets initial sync nodes as hidden,
# which causes a mismatch when the replica set is added to the sharded cluster
# through addShard, because the replica set's internal connection string does
# include the initial sync node, but the list of hosts in the replica set from
# running `hello`/`isMaster` does not include it. This parameter force-hides it
# from the connection string.
hide_initial_sync_node_from_conn_string: True
configsvr_options:
num_nodes: 2
start_initial_sync_node: True
initial_sync_uninitialized_fcv: True
hide_initial_sync_node_from_conn_string: True

View File

@ -6,6 +6,8 @@ selector:
- jstests/fle2/**/*.js
- src/mongo/db/modules/*/jstests/fle2/**/*.js
exclude_files:
# These tests are run in sharded_txns_uninitialized_fcv_jscore_passthrough.
- jstests/core/txns/**/*.js
### Tests that are excluded because of initial sync (from replica_sets_initsync_jscore_passthrough.yml)
# Tests that query the system.profile collection cannot run in this suite since an initial sync
# may insert unexpected operations into the profile collection.
@ -68,33 +70,14 @@ selector:
# we expect a second drop to return status OK.
- jstests/core/**/explain_upsert.js
### Tests that are excluded because of sharding and transactions (from sharded_jscore_txns.yml)
# Profile can only be run against the admin database on mongos.
- jstests/core/txns/transactions_profiling.js
- jstests/core/txns/transactions_profiling_with_drops.js
# Implicitly creates a database through a collection rename, which does not work in a sharded
# cluster.
- jstests/core/txns/transactions_block_ddl.js
# transactionLifetimeLimitSeconds parameter is not available in mongos.
- jstests/core/txns/abort_expired_transaction.js
- jstests/core/txns/abort_transaction_thread_does_not_block_on_locks.js
- jstests/core/txns/kill_op_on_txn_expiry.js
# Uses hangAfterCollectionInserts failpoint not available on mongos.
- jstests/core/txns/speculative_snapshot_includes_all_writes.js
# Will fail all commands including those needed to forward command to initial sync node.
- jstests/core/failcommand_failpoint.js
# Has asserts that depend on the use of fsyncLock which is skipped by this passthrough.
- jstests/core/ddl/killop_drop_collection.js
exclude_with_any_tags:
- assumes_standalone_mongod
- assumes_against_mongod_not_mongos
# Transactions are not allowed to operate on capped collections.
- requires_capped
# Prepare is not a command on mongos.
- uses_prepare_transaction
# system.profile collection doesn't exist on mongos.
- requires_profiling
@ -115,7 +98,7 @@ executor:
enableTestCommands: 1
collectionClonerBatchSize: 10
initialSyncOplogFetcherBatchSize: 10
num_shards: 2
num_shards: 1
num_rs_nodes_per_shard: 2
shard_options:
start_initial_sync_node: True

View File

@ -114,6 +114,7 @@ selector:
- jstests/core/write/update/update_setOnInsert.js
- jstests/core/write/update/upsert_fields.js
- jstests/core/write/update/upsert_fields_duplicate_or.js
- jstests/core/write/update/upsert_nor.js
- jstests/core/write/write_error_message_truncation.js
- jstests/core/write/write_result.js
# Time-series collections may generate different profiling entries from regular ones.
@ -157,7 +158,9 @@ selector:
- jstests/core/positional_projection.js # Positional projection
- jstests/core/query/batch_size.js # singleBatch
- jstests/core/query/dbref/dbref3.js # Positional projection
- jstests/core/query/explode_for_sort_plan_cache.js # Not first stage in pipeline
# Not first stage in pipeline. The following test uses $planCacheStats, which is required to be the
# first stage in a pipeline. This will be incomplatible with timeseries.
- jstests/core/query/in_expression_plan_cache.js
- jstests/core/query/find/find_getmore_cmd.js # singleBatch
- jstests/core/query/find/finda.js # returnKey
- jstests/core/query/index_key_expression.js # Unclean aggregation result
@ -180,6 +183,7 @@ selector:
- jstests/core/testminmax.js # min
# Different field ordering.
- jstests/core/query/basica.js
- jstests/core/query/group_lookup_with_canonical_query_prefix.js
- jstests/core/query/objid/objid3.js
- jstests/core/query/or/or1.js
- jstests/core/query/or/or2.js
@ -202,7 +206,6 @@ selector:
- jstests/core/query/type/type_array.js
- jstests/core/write/update/update_numeric_field_name.js
# Time-series collections have different indexes from regular collections.
- jstests/core/notablescan.js
- jstests/core/query/array/arrayfind4.js
- jstests/core/query/array/arrayfind9.js
- jstests/core/query/array/arrayfinda.js
@ -255,6 +258,9 @@ selector:
- jstests/core/query/cursor/getmore_invalidated_cursors.js
# TODO (SERVER-85205): Try to enable the test(s).
- jstests/core/write/update/upsert_and.js
# For inserts on time-series collections, mongod does _not_ replace empty timestamp values
# with the current time.
- jstests/core/query/empty_ts.js
exclude_with_any_tags:
- requires_sharding

View File

@ -0,0 +1,7 @@
test_kind: cpp_unit_test
selector:
root: build/first_quarter_unittests.txt
executor:
config: {}

View File

@ -0,0 +1,7 @@
test_kind: cpp_unit_test
selector:
root: build/fourth_quarter_unittests.txt
executor:
config: {}

View File

@ -0,0 +1,7 @@
test_kind: cpp_unit_test
selector:
root: build/second_quarter_unittests.txt
executor:
config: {}

View File

@ -0,0 +1,7 @@
test_kind: cpp_unit_test
selector:
root: build/third_quarter_unittests.txt
executor:
config: {}

View File

@ -145,6 +145,7 @@ DEFAULTS = {
"task_doc": None,
"variant_name": None,
"version_id": None,
"work_dir": None,
"evg_project_config_path": "etc/evergreen.yml",
# WiredTiger options.
@ -382,6 +383,9 @@ EVERGREEN_VARIANT_NAME = None
# the commit hash.
EVERGREEN_VERSION_ID = None
# The Evergreen task's working directory.
EVERGREEN_WORK_DIR = None
# Path to evergreen project configuration yaml file
EVERGREEN_PROJECT_CONFIG_PATH = None
@ -644,12 +648,16 @@ DEFAULT_UNIT_TEST_LIST = "build/unittests.txt"
DEFAULT_INTEGRATION_TEST_LIST = "build/integration_tests.txt"
DEFAULT_LIBFUZZER_TEST_LIST = "build/libfuzzer_tests.txt"
DEFAULT_PRETTY_PRINTER_TEST_LIST = "build/pretty_printer_tests.txt"
SPLIT_UNITTESTS_LISTS = [
f"build/{test_group}_quarter_unittests.txt"
for test_group in ['first', 'second', 'third', 'fourth']
]
# External files or executables, used as suite selectors, that are created during the build and
# therefore might not be available when creating a test membership map.
EXTERNAL_SUITE_SELECTORS = (DEFAULT_BENCHMARK_TEST_LIST, DEFAULT_UNIT_TEST_LIST,
DEFAULT_INTEGRATION_TEST_LIST, DEFAULT_DBTEST_EXECUTABLE,
DEFAULT_LIBFUZZER_TEST_LIST, DEFAULT_PRETTY_PRINTER_TEST_LIST)
DEFAULT_LIBFUZZER_TEST_LIST, DEFAULT_PRETTY_PRINTER_TEST_LIST,
*SPLIT_UNITTESTS_LISTS)
# Where to look for logging and suite configuration files
CONFIG_DIR = None

View File

@ -484,6 +484,7 @@ or explicitly pass --installDir to the run subcommand of buildscripts/resmoke.py
_config.EVERGREEN_TASK_DOC = config.pop("task_doc")
_config.EVERGREEN_VARIANT_NAME = config.pop("variant_name")
_config.EVERGREEN_VERSION_ID = config.pop("version_id")
_config.EVERGREEN_WORK_DIR = config.pop("work_dir")
_config.EVERGREEN_PROJECT_CONFIG_PATH = config.pop("evg_project_config_path")
# otel info
@ -510,6 +511,8 @@ or explicitly pass --installDir to the run subcommand of buildscripts/resmoke.py
)
if not setup_success:
print("Failed to create file to send otel metrics to. Continuing.")
except (KeyboardInterrupt, SystemExit):
raise
except:
# We want this as a catch all exception
# If there is some problem setting up metrics we don't want resmoke to fail
@ -730,4 +733,5 @@ def detect_evergreen_config(parsed_args: argparse.Namespace,
parsed_args.task_name = expansions.get("task_name", None)
parsed_args.variant_name = expansions.get("build_variant", None)
parsed_args.version_id = expansions.get("version_id", None)
parsed_args.work_dir = expansions.get("workdir", None)
parsed_args.evg_project_config_path = expansions.get("evergreen_config_file_path", None)

View File

@ -14,6 +14,7 @@ CREATE_BUILD_ENDPOINT = "/build"
APPEND_GLOBAL_LOGS_ENDPOINT = "/build/%(build_id)s"
CREATE_TEST_ENDPOINT = "/build/%(build_id)s/test"
APPEND_TEST_LOGS_ENDPOINT = "/build/%(build_id)s/test/%(test_id)s"
PARSLEY_LOGS_URL = "https://parsley.mongodb.com/resmoke/%(build_id)s/test/%(test_id)s"
_BUILDLOGGER_CONFIG = os.getenv("BUILDLOGGER_CREDENTIALS", "mci.buildlogger")
@ -342,3 +343,8 @@ class BuildloggerServer(object):
base_url = _config.BUILDLOGGER_URL.rstrip("/")
endpoint = APPEND_TEST_LOGS_ENDPOINT % {"build_id": build_id, "test_id": test_id}
return "%s/%s" % (base_url, endpoint.strip("/"))
@staticmethod
def get_parsley_log_url(build_id, test_id):
"""Return the parsley log URL."""
return PARSLEY_LOGS_URL % {"build_id": build_id, "test_id": test_id}

View File

@ -19,3 +19,16 @@ class TimestampFormatter(logging.Formatter):
formatted_time = time.strftime("%H:%M:%S", converted_time)
return "%s.%03dZ" % (formatted_time, record.msecs)
class EvergreenLogFormatter(logging.Formatter):
"""Log line formatter for Evergreen log messages.
See `https://docs.devprod.prod.corp.mongodb.com/evergreen/Project-Configuration/Task-Output-Directory#test-logs`
for more info.
"""
def format(self, record):
ts = int(record.created * 1e9)
return "\n".join([f"{ts} {line}" for line in super().format(record).split("\n")])

View File

@ -231,6 +231,29 @@ class BufferedHandler(logging.Handler):
logging.Handler.close(self)
class BufferedFileHandler(BufferedHandler):
"""File handler with in-memory buffering."""
def __init__(self, filename, capacity=2000, interval_secs=600):
"""Initialize the handler with the filename and buffer capacity and flush interval."""
super().__init__(capacity, interval_secs)
self.file = open(filename, "a")
def process_record(self, record):
"""Return the formatted record message appended with a newline."""
return self.format(record) + "\n"
def _flush_buffer_with_lock(self, buf, close_called):
"""Write the buffered log lines to the destination file."""
self.file.writelines(buf)
def close(self):
"""Close the handler and the file descriptor."""
super().close()
self.file.close()
class HTTPHandler(object):
"""A class which sends data to a web server using POST requests."""

View File

@ -1,17 +1,19 @@
"""Module to hold the logger instances themselves."""
import logging
import os
import re
import shutil
import subprocess
import sys
import yaml
from buildscripts.resmokelib import config
from buildscripts.resmokelib import errors
from buildscripts.resmokelib.core import redirect as redirect_lib
from buildscripts.resmokelib.logging import buildlogger
from buildscripts.resmokelib.logging import formatters
from buildscripts.resmokelib.logging.handlers import ExceptionExtractionHandler, ExceptionExtractor, Truncate
from buildscripts.resmokelib.logging.handlers import BufferedFileHandler, ExceptionExtractionHandler, ExceptionExtractor, Truncate
_DEFAULT_FORMAT = "[%(name)s] %(message)s"
@ -95,6 +97,13 @@ def configure_loggers():
global ROOT_EXECUTOR_LOGGER # pylint: disable=global-statement
ROOT_EXECUTOR_LOGGER = new_root_logger(EXECUTOR_LOGGER_NAME)
_write_evergreen_log_spec()
def get_evergreen_log_name(job_num, test_id=None):
"""Return the log name, relative to the reserved test log directory, on the Evergreen task host."""
return f"job{job_num}/" + (f"{test_id}.log" if test_id else "global.log")
def new_root_logger(name):
"""
@ -173,6 +182,7 @@ def new_fixture_logger(fixture_class, job_num):
logger = FixtureLogger(_shorten(full_name), full_name, external_sut_hostname)
logger.parent = ROOT_FIXTURE_LOGGER
_add_build_logger_handler(logger, job_num)
_add_evergreen_handler(logger, job_num)
_FIXTURE_LOGGER_REGISTRY[job_num] = logger
return logger
@ -225,6 +235,7 @@ def new_test_logger(test_shortname, test_basename, command, parent, job_num, tes
name = "%s:%s" % (parent.name, test_shortname)
logger = logging.Logger(name)
logger.parent = parent
_add_evergreen_handler(logger, job_num, test_id)
def _get_test_endpoint(job_num, test_basename, command, meta_logger):
"""Get a new test endpoint for the buildlogger server."""
@ -242,7 +253,8 @@ def new_test_logger(test_shortname, test_basename, command, parent, job_num, tes
" test_id".format(test_basename))
url = BUILDLOGGER_SERVER.get_test_log_url(build_id, test_id)
meta_logger.info("Writing output of %s to %s.", test_basename, url)
parsley_url = BUILDLOGGER_SERVER.get_parsley_log_url(build_id, test_id)
meta_logger.info("Writing output of %s to %s.", test_basename, parsley_url)
return (test_id, url)
@ -283,6 +295,8 @@ def _add_handler(logger, handler_info, formatter):
handler = logging.StreamHandler(sys.stdout)
elif handler_class == "buildlogger":
return # Buildlogger handlers are applied when creating specific child loggers
elif handler_class == "evergreen":
return # Evergreen handlers are applied when creating specific child loggers
else:
raise ValueError("Unknown handler class '%s'" % handler_class)
handler.setFormatter(formatter)
@ -352,3 +366,55 @@ def _shorten(logger_name):
logger_name = re.sub(r"(^[:_]+|[:_]+$)", "", logger_name)
return logger_name
# Utility functions for Evergreen file system logging.
# See `https://docs.devprod.prod.corp.mongodb.com/evergreen/Project-Configuration/Task-Output-Directory#test-logs`
# for more information.
def _write_evergreen_log_spec():
"""Configure file system logging for Evergreen tasks."""
if not config.EVERGREEN_WORK_DIR:
return
fp = f"{_get_evergreen_log_dirname()}/log_spec.yaml"
os.makedirs(os.path.dirname(fp), exist_ok=True)
ROOT_EXECUTOR_LOGGER.info("Writing Evergreen test log spec to %s.", fp)
log_spec = {
"version": 0,
"format": "text-timestamp",
}
with open(fp, "w") as f:
yaml.dump(log_spec, f)
def _add_evergreen_handler(logger, job_num, test_id=None):
"""Add a new evergreen handler to a logger."""
logger_info = config.LOGGING_CONFIG[TESTS_LOGGER_NAME]
evergreen_handler_info = None
for handler_info in logger_info["handlers"]:
if handler_info["class"] == "evergreen":
evergreen_handler_info = handler_info
break
if evergreen_handler_info:
fp = f"{_get_evergreen_log_dirname()}/{get_evergreen_log_name(job_num, test_id)}"
os.makedirs(os.path.dirname(fp), exist_ok=True)
handler = BufferedFileHandler(fp)
handler.setFormatter(
formatters.EvergreenLogFormatter(fmt=logger_info.get("format", _DEFAULT_FORMAT)))
logger.addHandler(handler)
if test_id:
ROOT_EXECUTOR_LOGGER.info("Writing output of %s to %s.", test_id, fp)
else:
ROOT_EXECUTOR_LOGGER.info("Writing output of job #%d to %s.", job_num, fp)
def _get_evergreen_log_dirname():
"""Return the reserved directory for test logs on the Evergreen task host."""
return f"{config.EVERGREEN_WORK_DIR}/build/TestLogs"

View File

@ -147,17 +147,6 @@ def generate_mongod_parameters(rng, mode):
ret["wiredTigerConcurrentReadTransactions"] = rng.randint(5, 32)
ret["wiredTigerStressConfig"] = False if mode != 'stress' else rng.choice([True, False])
ret["oplogFetcherUsesExhaust"] = rng.choice([True, False])
ret["replWriterThreadCount"] = rng.randint(1, 256)
ret["replBatchLimitOperations"] = rng.randint(1, 1000 * 1000)
ret["replBatchLimitBytes"] = rng.randint(16 * 1024 * 1024, 100 * 1024 * 1024)
# For `initialSyncSourceReadPreference`, the option `secondary` is excluded from the fuzzer
# because the generated mongod parameters are used for every node in the replica set, so the
# secondaries in the replica set will not be able to find a valid sync source.
ret["initialSyncSourceReadPreference"] = rng.choice(
["nearest", "primary", "primaryPreferred", "secondaryPreferred"])
ret["initialSyncMethod"] = rng.choice(["fileCopyBased", "logical"])
# We need a higher timeout to account for test slowness
ret["receiveChunkWaitForRangeDeleterTimeoutMS"] = 300000
ret["defaultConfigCommandTimeoutMS"] = 90000

View File

@ -95,7 +95,8 @@ class MultiversionPlugin(PluginInterface):
:param kwargs: additional args.
:return: None or a Subcommand.
"""
configure_resmoke.validate_and_update_config(parser, parsed_args)
if subcommand == MULTIVERSION_SUBCOMMAND:
configure_resmoke.detect_evergreen_config(parsed_args)
configure_resmoke.validate_and_update_config(parser, parsed_args)
return MultiversionConfigSubcommand(parsed_args)
return None

View File

@ -2,7 +2,9 @@
import os
import shutil
from subprocess import DEVNULL, STDOUT, CalledProcessError, call, check_output
import http
import requests
from retry import retry
import structlog
import buildscripts.resmokelib.config as _config
@ -38,11 +40,16 @@ def generate_mongo_version_file():
mongo_version_fh.write("mongo_version: " + res)
@retry(tries=5, delay=3)
def get_releases_file_from_remote():
"""Get the latest releases.yml from github."""
try:
with open(RELEASES_YAML, "wb") as file:
file.write(requests.get(MASTER_RELEASES_REMOTE_FILE).content)
response = requests.get(MASTER_RELEASES_REMOTE_FILE)
if response.status_code != http.HTTPStatus.OK:
raise RuntimeError("Http response for releases yml file was not 200 but was " +
response.status_code)
file.write(response.content)
LOGGER.info(f"Got releases.yml file remotely: {MASTER_RELEASES_REMOTE_FILE}")
except Exception as exc:
LOGGER.warning(f"Could not get releases.yml file remotely: {MASTER_RELEASES_REMOTE_FILE}")

View File

@ -1337,6 +1337,9 @@ class RunPlugin(PluginInterface):
evergreen_options.add_argument("--versionId", dest="version_id", metavar="VERSION_ID",
help="Sets the version ID of the task.")
evergreen_options.add_argument("--taskWorkDir", dest="work_dir", metavar="TASK_WORK_DIR",
help="Sets the working directory of the task.")
evergreen_options.add_argument(
"--projectConfigPath", dest="evg_project_config_path",
help="Sets the path to evergreen project configuration yaml.")

View File

@ -23,6 +23,7 @@ BACKPORT_REQUIRED_TAG = "backport_required_multiversion"
ETC_DIR = "etc"
BACKPORTS_REQUIRED_FILE = "backports_required_for_multiversion_tests.yml"
BACKPORTS_REQUIRED_BASE_URL = "https://raw.githubusercontent.com/10gen/mongo"
BACKPORTS_REQUIRED_BASE_URL_BACKUP = "https://raw.githubusercontent.com/mongodb/mongo"
def get_installation_access_token(app_id: int, private_key: str,
@ -87,11 +88,16 @@ def get_old_yaml(commit_hash, expansions_file):
expansions["app_id_10gen_mongo"], expansions["private_key_10gen_mongo"],
expansions["installation_id_10gen_mongo"])
response = requests.get(
f'{BACKPORTS_REQUIRED_BASE_URL}/{commit_hash}/{ETC_DIR}/{BACKPORTS_REQUIRED_FILE}',
headers={
'Authorization': f'token {access_token_10gen_mongo}',
})
url = f'{BACKPORTS_REQUIRED_BASE_URL}/{commit_hash}/{ETC_DIR}/{BACKPORTS_REQUIRED_FILE}'
response = requests.get(url, headers={
'Authorization': f'token {access_token_10gen_mongo}',
})
if response.status_code != requests.codes["ok"]:
print(f"Request to {url} failed with status {response.status_code}")
url = f'{BACKPORTS_REQUIRED_BASE_URL_BACKUP}/{commit_hash}/{ETC_DIR}/{BACKPORTS_REQUIRED_FILE}'
print(f"Trying {url} instead.")
response = requests.get(url)
# If the response was successful, no exception will be raised.
response.raise_for_status()

View File

@ -387,6 +387,7 @@ class ShardedClusterFixture(interface.Fixture, interface._DockerComposeInterface
del mongod_options["shardsvr"]
mongod_options["configsvr"] = ""
replset_config_options["configsvr"] = True
mongod_options["set_parameters"]["featureFlagTransitionToCatalogShard"] = "true"
mongod_options["storageEngine"] = "wiredTiger"
configsvr_options = self.configsvr_options.copy()
@ -437,6 +438,8 @@ class ShardedClusterFixture(interface.Fixture, interface._DockerComposeInterface
"""Return options that may be passed to a mongos."""
mongos_options = self.mongos_options.copy()
mongos_options["configdb"] = self.configsvr.get_internal_connection_string()
if self.config_shard is not None:
mongos_options["set_parameters"]["featureFlagTransitionToCatalogShard"] = "true"
mongos_options["set_parameters"] = mongos_options.get("set_parameters",
self.fixturelib.make_historic(
{})).copy()

View File

@ -8,8 +8,7 @@ from buildscripts.resmokelib.testing.hooks.interface import Hook
from bson import binary
import pymongo.errors
QUERY_FEATURE_NOT_ALLOWED_CODE = 224
QUERY_STATS_NOT_ENABLED_CODE = 7373500
QUERY_STATS_NOT_ENABLED_CODES = [224, 7373500, 6579000]
class RunQueryStats(Hook):
@ -41,11 +40,11 @@ class RunQueryStats(Hook):
assert "metrics" in operation
assert "asOf" in operation
except pymongo.errors.OperationFailure as err:
if not self.allow_feature_not_supported or err.code != QUERY_FEATURE_NOT_ALLOWED_CODE:
raise err
else:
self.logger.info("Encountered a 'QueryFeatureNotAllowed' error. "
if self.allow_feature_not_supported and err.code in QUERY_STATS_NOT_ENABLED_CODES:
self.logger.info("Encountered an error while running $queryStats. "
"$queryStats will not be run for this test.")
else:
raise err
def after_test(self, test, test_report):
self.verify_query_stats({})
@ -58,8 +57,8 @@ class RunQueryStats(Hook):
self.client.admin.command("setParameter", 1, internalQueryStatsCacheSize="0%")
self.client.admin.command("setParameter", 1, internalQueryStatsCacheSize="1%")
except pymongo.errors.OperationFailure as err:
if not self.allow_feature_not_supported or err.code != QUERY_STATS_NOT_ENABLED_CODE:
raise err
else:
if self.allow_feature_not_supported and err.code in QUERY_STATS_NOT_ENABLED_CODES:
self.logger.info("Encountered an error while configuring the query stats store. "
"Query stats will not be collected for this test.")
else:
raise err

View File

@ -5,6 +5,7 @@ This is used to support additional test status and timing information for the re
"""
import copy
import os
import threading
import time
import unittest
@ -116,6 +117,7 @@ class TestReport(unittest.TestResult):
unittest.TestResult.startTest(self, test)
test_info = TestInfo(test.id(), test.test_name, test.dynamic)
test_info.group_id = f"job{self.job_num}"
basename = test.basename()
command = test.as_command()
@ -140,6 +142,11 @@ class TestReport(unittest.TestResult):
# Set up logging handlers to capture exceptions.
test_info.exception_extractors = logging.loggers.configure_exception_capture(test_logger)
test_info.log_info = {
"log_name": logging.loggers.get_evergreen_log_name(self.job_num, test.id()),
"logs_to_merge": [logging.loggers.get_evergreen_log_name(self.job_num)],
"rendering_type": "resmoke", "version": 0
}
test_info.url_endpoint = url_endpoint
if self.logging_prefix is not None:
test_logger.info(self.logging_prefix)
@ -303,19 +310,18 @@ class TestReport(unittest.TestResult):
for test_info in self.test_infos:
result = {
"test_file": test_info.test_file,
"group_id": test_info.group_id,
"status": test_info.evergreen_status,
"exit_code": test_info.return_code,
"start": test_info.start_time,
"end": test_info.end_time,
"elapsed": test_info.end_time - test_info.start_time,
"log_info": test_info.log_info,
}
if test_info.display_test_name is not None:
result["display_test_name"] = test_info.display_test_name
if test_info.group_id is not None:
result["group_id"] = test_info.group_id
if test_info.url_endpoint is not None:
result["url"] = test_info.url_endpoint
result["url_raw"] = test_info.url_endpoint + "?raw=1"
@ -345,6 +351,7 @@ class TestReport(unittest.TestResult):
test_info = TestInfo(test_file, test_file, is_dynamic)
test_info.display_test_name = result.get("display_test_name")
test_info.group_id = result.get("group_id")
test_info.log_info = result.get("log_info")
test_info.url_endpoint = result.get("url")
test_info.status = result["status"]
test_info.evergreen_status = test_info.status
@ -398,16 +405,17 @@ class TestInfo(object):
self.test_id = test_id
self.test_file = test_file
self.group_id = None
self.display_test_name = None
self.dynamic = dynamic
self.loggers = []
self.group_id = None
self.start_time = None
self.end_time = None
self.status = None
self.evergreen_status = None
self.return_code = None
self.log_info = None
self.url_endpoint = None
self.exception_extractors = []
self.error = None

View File

@ -86,7 +86,7 @@ def get_task_name_without_suffix(task_name, variant_name):
"""Return evergreen task name without suffix added to the generated task.
Remove evergreen variant name, numerical suffix and underscores between them from evergreen task name.
Example: "noPassthrough_0_enterprise-rhel-80-64-bit-dynamic-required" -> "noPassthrough"
Example: "noPassthrough_0_enterprise-rhel-8-64-bit-dynamic-required" -> "noPassthrough"
"""
task_name = task_name if task_name else ""
return re.sub(fr"(_[0-9]+)?(_{variant_name})?$", "", task_name)

View File

@ -26,25 +26,35 @@ if [[ "${machine}" = "Cygwin" ]]; then
echo "----------------------"
echo -e "\n=> Setting _NT_SOURCE_PATH environment variable for debuggers to pick up source files."
SRC_DIR_HASH=$(readlink -f /cygdrive/z/data/mci/source-*)
SRC_DIR="${SRC_DIR_HASH}/src"
SRC_DIR_HASH=$(find /cygdrive/z/data/mci -name 'source-*' | head -n 1 | xargs -I% basename %)
SRC_DIR="Z:\data\mci\\${SRC_DIR_HASH}\src"
echo "Source Path: [${SRC_DIR}]"
set -x;
setx _NT_SOURCE_PATH "${SRC_DIR}"
{ set +x; } 2>/dev/null
echo -e "\n=> Setting _NT_SYMBOL_PATH environment variable for debuggers to pick up the symbols."
DBG_SYMBOLS_HASH=$(find /cygdrive/z/data/mci -name 'artifacts-*dist_test_debug' | head -n 1 | xargs -I% basename %)
DBG_SYMBOLS_WINPATH="\"Z:\data\mci\\${DBG_SYMBOLS_HASH}\extracted_symbols\dist-test\bin;srv*;\""
DBG_ARCHIVE_PARENT=$(readlink -f /cygdrive/z/data/mci/artifacts-*dist_test_debug)
DBG_ARCHIVE=$(readlink -f ${DBG_ARCHIVE_PARENT}/debugsymbols-*.zip)
DBG_ARCHIVE_TARGET_PARENT="${DBG_ARCHIVE_PARENT}/extracted_symbols"
DBG_ARCHIVE_TARGET="${DBG_ARCHIVE_TARGET_PARENT}/dist-test/bin"
echo "Symbols Dir: [${DBG_ARCHIVE_TARGET}]"
echo -e "\n=> Copying .natvis file to Visual Studio's expected directories (System for 2017/2019 and User)."
set -x;
cp "/cygdrive/z/data/mci/${SRC_DIR_HASH}/buildscripts/win/mongodb.natvis" /cygdrive/c/Program\ Files\ \(x86\)/Microsoft\ Visual\ Studio/2017/Professional/Common7/Packages/Debugger/Visualizers
cp "/cygdrive/z/data/mci/${SRC_DIR_HASH}/buildscripts/win/mongodb.natvis" /cygdrive/c/Program\ Files\ \(x86\)/Microsoft\ Visual\ Studio/2019/Professional/Common7/Packages/Debugger/Visualizers
mkdir "${USERPROFILE}/Documents/Visual Studio 2022/Visualizers"
cp "/cygdrive/z/data/mci/${SRC_DIR_HASH}/buildscripts/win/mongodb.natvis" "${USERPROFILE}/Documents/Visual Studio 2022/Visualizers"
{ set +x; } 2>/dev/null
echo -e "\n=> Extracting Symbol files."
set -x;
mkdir -p ${DBG_ARCHIVE_TARGET_PARENT}
unzip -n ${DBG_ARCHIVE} -d ${DBG_ARCHIVE_TARGET_PARENT}
setx _NT_SYMBOL_PATH "${DBG_ARCHIVE_TARGET};srv*;"
setx _NT_SYMBOL_PATH "${DBG_SYMBOLS_WINPATH}"
{ set +x; } 2>/dev/null
echo -e "\n=> Extracting Core Dumps to Desktop."
@ -93,6 +103,7 @@ if [[ "${machine}" = "Cygwin" ]]; then
if [[ -z $(ls ${COREDUMP_ARCHIVE_TARGET}/dump* 2>/dev/null) ]]; then
echo "No core dumps found."
fi
{ set +x; } 2>/dev/null
echo "Copied to Desktop."
} &> ${out_dir}
@ -173,7 +184,7 @@ fi' >> .bash_profile
archive_fail "debug"
fi
UNITTEST_ARCHIVE=$(ls /data/mci/artifacts-*run_unittests/mongo-unittests-*.tgz 2>/dev/null)
UNITTEST_ARCHIVE=$(ls /data/mci/artifacts-*run_unittests*/mongo-unittests-*.tgz 2>/dev/null)
if [[ -n $UNITTEST_ARCHIVE ]]; then
tar --wildcards --strip-components=0 -xzf $UNITTEST_ARCHIVE 'bin/*' &
tar --wildcards -xzf $UNITTEST_ARCHIVE 'lib/*' &
@ -181,9 +192,10 @@ fi' >> .bash_profile
archive_fail "unittest"
fi
BENCHMARK_ARCHIVE=$(ls /data/mci/artifacts-*compile_upload_benchmarks/mongodb_mongo_*.tgz 2>/dev/null)
BENCHMARK_ARCHIVE=$(ls /data/mci/artifacts-*compile_upload_benchmarks/benchmarks-*.tgz 2>/dev/null)
if [[ -n $BENCHMARK_ARCHIVE ]]; then
tar --wildcards --strip-components=2 -xzf $BENCHMARK_ARCHIVE '*/bin/*' &
tar --wildcards --strip-components=0 -xzf $BENCHMARK_ARCHIVE 'bin/*' &
tar --wildcards -xzf $BENCHMARK_ARCHIVE 'lib/*' &
else
archive_fail "benchmark"
fi

View File

@ -1,7 +1,7 @@
"""
Get the display task name from the execution task and the variant.
Get an execution task name like this: multiversion_auth_0_enterprise-rhel-80-64-bit-dynamic-all-feature-flags-required
Get an execution task name like this: multiversion_auth_0_enterprise-rhel-8-64-bit-dynamic-all-feature-flags-required
Into a display task name like this: multiversion_auth
"""

View File

@ -579,7 +579,7 @@ class TestBurnInTestsOutput(unittest.TestCase):
def test_valid_yaml(self):
process = subprocess.run([
sys.executable, "buildscripts/burn_in_tests.py", "run", "--build-variant",
"enterprise-rhel-80-64-bit-dynamic-classic-engine", "--yaml", "--evg-project-file",
"enterprise-rhel-8-64-bit-dynamic-classic-engine", "--yaml", "--evg-project-file",
"etc/evergreen.yml"
], text=True, capture_output=True)
output = process.stdout

View File

@ -28,7 +28,7 @@ class TestRemoveGenSuffix(unittest.TestCase):
class TestDetermineTaskBaseName(unittest.TestCase):
def test_task_name_with_build_variant_should_strip_bv_and_sub_task_index(self):
bv = "enterprise-rhel-80-64-bit-dynamic-all-feature-flags-required"
bv = "enterprise-rhel-8-64-bit-dynamic-all-feature-flags-required"
task_name = f"auth_23_{bv}"
base_task_name = under_test.determine_task_base_name(task_name, bv)
@ -36,7 +36,7 @@ class TestDetermineTaskBaseName(unittest.TestCase):
self.assertEqual("auth", base_task_name)
def test_task_name_without_build_variant_should_strip_sub_task_index(self):
bv = "enterprise-rhel-80-64-bit-dynamic-all-feature-flags-required"
bv = "enterprise-rhel-8-64-bit-dynamic-all-feature-flags-required"
task_name = "auth_314"
base_task_name = under_test.determine_task_base_name(task_name, bv)
@ -44,7 +44,7 @@ class TestDetermineTaskBaseName(unittest.TestCase):
self.assertEqual("auth", base_task_name)
def test_task_name_without_build_variant_or_subtask_index_should_self(self):
bv = "enterprise-rhel-80-64-bit-dynamic-all-feature-flags-required"
bv = "enterprise-rhel-8-64-bit-dynamic-all-feature-flags-required"
task_name = "auth"
base_task_name = under_test.determine_task_base_name(task_name, bv)

View File

@ -1,14 +1,16 @@
<?xml version="1.0" encoding="utf-8"?>
<?xml version="1.0" encoding="utf-8"?>
<AutoVisualizer xmlns="http://schemas.microsoft.com/vstudio/debugger/natvis/2010">
<!--
NatVis Documentation:
NatVis Documentation:
https://docs.microsoft.com/en-us/visualstudio/debugger/create-custom-views-of-native-objects?view=vs-2017
Boost Visualizers:
https://marketplace.visualstudio.com/items?itemName=ArkadyShapkin.CDebuggerVisualizersforVS2017
https://github.com/KindDragon/CPPDebuggerVisualizers
To load in Visual Studio, the natvis file must be in the Visual Studio project.
Note: with buildscripts/setup_spawnhost_coredump, this file should be automatically placed in the user-specific Natvis directory.
https://learn.microsoft.com/en-us/visualstudio/debugger/create-custom-views-of-native-objects?view=vs-2022#BKMK_natvis_location
To load in WinDBG, run ".nvload mongdb.natvis"
-->
<Type Name="mongo::Status">
@ -63,16 +65,16 @@
<Expand>
<CustomListItems>
<Variable Name="Code" InitialValue="(const char*)this+4"/>
<Item Name="code">Code+4,[*(int32_t*)(Code)-1]s8</Item>
<Item Name="scope">*(mongo::BSONObjData*)(Code+*(int32_t*)(Code)+4)</Item>
</CustomListItems>
</Expand>
</Type>
<!--
<!--
It it not possible to use variables to calculate contents in the DisplayString nodes.
this+strlen((char*)&amp;name)+2: Skips over the type byte and the name with its null terminator to get to the beginning of the value
-->
<Type Name="mongo::BSONElementData">
@ -221,7 +223,7 @@
<!-- MinKey/MaxKey -->
<DisplayString Condition="*(char*)data==-1">{{ {data+1,s8}, MinKey }}</DisplayString>
<DisplayString Condition="*(char*)data==0x7f">{{ {data+1,s8}, MaxKey }}</DisplayString>
<Expand>
<Item Name="name">(const char*)data+1,s8</Item>
<Item Name="value">(const mongo::BSONElementData*)data,na</Item>

View File

@ -7,13 +7,13 @@ core.workflow(
name = "default",
origin = git.origin(
url = sourceUrl,
ref = "master",
ref = "v7.3",
# VersionSelector
),
destination = git.destination(
url = destinationUrl,
fetch = "master",
push = "master",
fetch = "v7.3",
push = "v7.3",
),
# Change path to the folder you want to publish publicly
origin_files = glob(["**"], exclude=["src/mongo/db/modules/**"]),

View File

@ -7,13 +7,13 @@ core.workflow(
name = "default",
origin = git.origin(
url = sourceUrl,
ref = "master",
ref = "v7.3",
# VersionSelector
),
destination = git.destination(
url = destinationUrl,
fetch = "master",
push = "master",
fetch = "v7.3",
push = "v7.3",
),
# Change path to the folder you want to publish publicly
origin_files = glob(["**"], exclude=["src/mongo/db/modules/**"]),

View File

@ -83,5 +83,6 @@ LICENSE
2018 are published under the AGPL. All versions released after October
16, 2018, including patch fixes for prior versions, are published under
the Server Side Public License (SSPL) v1. See individual files for
details.
details which will specify the license applicable to each file. Files
subject to the SSPL will be noted in their headers.

View File

@ -11,7 +11,7 @@ original build variants, `burn_in_tags` runs them on the burn_in build variants
## How to use it
You can use `burn_in_tags` on evergreen by selecting the `burn_in_tags_gen` task when creating a patch.
The burn_in build variants, i.e., `enterprise-rhel-80-64-bit-inmem` and `enterprise-rhel-80-64-bit-multiversion`
The burn_in build variants, i.e., `enterprise-rhel-8-64-bit-inmem` and `enterprise-rhel-8-64-bit-multiversion`
will be generated, each of which will have a `burn_in_tests` task generated by the
[mongo-task-generator](https://github.com/mongodb/mongo-task-generator). `burn_in_tests` task, a
[generated task](task_generation.md), may have multiple sub-tasks which run the test suites only for the new, or changed, or

View File

@ -21,13 +21,11 @@ function.
![fsm.png](../images/testing/fsm.png)
The runner provides three modes of execution for workloads: serial, parallel,
and composed. Serial mode runs the provided workloads one after the other,
The runner provides two modes of execution for workloads: serial and parallel.
Serial mode runs the provided workloads one after the other,
waiting for all threads of a workload to complete before moving on to the next
workload. Parallel mode runs subsets of the provided workloads in separate
threads simultaneously. Composed mode runs subsets of the provided workloads in
the same threads simultaneously, with each thread moving between the states of
multiple workloads.
threads simultaneously.
New methods were added to allow for finer-grained assertions under different
situations. For example, a test that inserts a document into a collection, and
@ -103,9 +101,8 @@ It's best to also declare states within its own closure so as not to interfere
with the scope of $config. Each state takes two arguments, the db object and the
collection name. For later, note that this db and collection are the only one
that you can be guaranteed to "own" when asserting. Try to make each state a
discrete unit of work that can stand alone without the other states (in fact, an
FSM that requires another state to run before it will probably not work in
Composed mode). Additionally, try to define each function that makes up a state
discrete unit of work that can stand alone without the other states.
Additionally, try to define each function that makes up a state
with a name as opposed to anonymously - this makes easier to read backtraces
when things go wrong.
@ -362,11 +359,9 @@ runWorkloads functions, the third argument, can contain the following options
(some depend on the run mode):
* `numSubsets` - Not available in serial mode, determines how many subsets of
workloads to execute in parallel or composed mode
workloads to execute in parallel mode
* `subsetSize` - Not available in serial mode, determines how large each subset of
workloads executed is
* `iterations` - Only available in composed mode, determines how many transitions
to perform between states in a single thread of composition.
#### fsm_all.js
@ -385,8 +380,8 @@ settings in `$config`.
#### fsm_all_replication.js
Sets up a replica set (with 3 mongods by default) and runs workloads serially,
in parallel, or in composed mode. For example,
Sets up a replica set (with 3 mongods by default) and runs workloads serially or
in parallel. For example,
`runWorkloadsSerially([<workload1>, <workload2>, ...], { replication: true } )`
@ -396,7 +391,7 @@ primary.
#### fsm_all_sharded.js
Sets up a sharded cluster (with 2 shards and 1 mongos by default) and runs
workloads serially, in parallel, or in composed mode. For example,
workloads serially or in parallel. For example,
`runWorkloadsInParallel([<workload1>, <workload2>, ...], { sharded: true } )`
@ -405,8 +400,7 @@ creates a sharded cluster and runs workloads in parallel.
#### fsm_all_sharded_replication.js
Sets up a sharded cluster (with 2 shards, each having 3 replica set members, and
1 mongos by default) and runs workloads serially, in parallel, or in composed
mode.
1 mongos by default) and runs workloads serially or in parallel.
### Excluding a workload

View File

@ -21,6 +21,16 @@
#
last-continuous:
all:
- test_file: jstests/replsets/ignore_dbcheck_in_startup_recovery.js
ticket: SERVER-30832
- test_file: jstests/core/write/update/upsert_nor.js
ticket: SERVER-91700
- test_file: jstests/replsets/ignore_dbcheck_in_rollback.js
ticket: SERVER-30832
- test_file: jstests/replsets/ignore_dbcheck_in_initial_sync.js
ticket: SERVER-80340
- test_file: jstests/replsets/dbcheck_skip_applying_batch_on_secondary_parameter.js
ticket: SERVER-88885
- test_file: jstests/sharding/config_shards_on_repl_set_changes.js
ticket: SERVER-21185
- test_file: jstests/sharding/query/find_and_modify_without_two_phase.js
@ -33,6 +43,8 @@ last-continuous:
ticket: SERVER-50792
- test_file: jstests/sharding/refine_collection_shard_key_basic.js
ticket: SERVER-50792
- test_file: jstests/core/index/elemmatch_index.js
ticket: SERVER-90747
- test_file: jstests/replsets/tenant_migration_fetch_committed_transactions_retry.js
ticket: SERVER-51943
- test_file: jstests/sharding/query/collation_shard_targeting_hashed_shard_key.js
@ -394,7 +406,7 @@ last-continuous:
- test_file: jstests/sharding/query/sharded_lookup_execution.js
ticket: SERVER-77427
- test_file: jstests/sharding/multi_collection_transaction_placement_conflict_workaround.js
ticket: SERVER-82353
ticket: SERVER-86583
- test_file: jstests/sharding/fsync_lock_unlock.js
ticket: SERVER-73685
- test_file: jstests/sharding/fsync_lock_ddl_lock.js
@ -557,17 +569,105 @@ last-continuous:
ticket: SERVER-84130
- test_file: jstests/noPassthrough/disallow_new_transactions_at_shutdown_on_mongos.js
ticket: SERVER-77667
- test_file: jstests/core/timeseries/timeseries_collmod.js
ticket: SERVER-83370
- test_file: jstests/core/timeseries/timeseries_lookup.js
ticket: SERVER-79637
- test_file: jstests/core/notablescan.js
- test_file: jstests/noPassthrough/notablescan.js
ticket: SERVER-83119
- test_file: jstests/sharding/clustered_coll_scan.js
ticket: SERVER-83119
- test_file: jstests/sharding/eof_plan.js
ticket: SERVER-83119
- test_file: jstests/core/command_let_variables_expressions.js
ticket: SERVER-89268
- test_file: jstests/sharding/analyze_shard_key/sample_write_queries_sharded.js
ticket: SERVER-89268
- test_file: jstests/sharding/analyze_shard_key/sample_write_queries_unsharded.js
ticket: SERVER-89268
- test_file: jstests/change_streams/split_large_event_with_other_stages.js
ticket: SERVER-85848
- test_file: jstests/sharding/timeseries_drop.js
ticket: SERVER-84589
- test_file: jstests/sharding/updateOne_without_shard_key/write_without_shard_key_single_shard_data_placement_change.js
ticket: SERVER-87191
- test_file: jstests/core/query/bittest.js
ticket: SERVER-86419
- test_file: jstests/core/timeseries/timeseries_project.js
ticket: SERVER-87987
- test_file: jstests/core/administrative/apply_ops/apply_ops1.js
ticket: SERVER-82349
- test_file: jstests/sharding/swallow_unnecessary_uuid_mismatch_error.js
ticket: SERVER-79049
- test_file: jstests/sharding/view_query_readConcern_available.js
ticket: SERVER-86667
- test_file: jstests/replsets/reconstruct_prepared_transactions_initial_sync.js
ticket: SERVER-89618
- test_file: jstests/core/timeseries/timeseries_computed_field.js
ticket: SERVER-88072
- test_file: jstests/core/query/explain/explain_skip.js
ticket: SERVER-88949
- test_file: jstests/core/timeseries/timeseries_geonear_lookup.js
ticket: SERVER-81454
- test_file: jstests/sharding/move_chunk_deferred_lookup.js
ticket: SERVER-89859
- test_file: jstests/sharding/secondaries_clear_filtering_metadata.js
ticket: SERVER-86669
- test_file: jstests/aggregation/group_by_objectid.js
ticket: SERVER-90173
- test_file: jstests/replsets/catchup_ignores_old_heartbeats.js
ticket: SERVER-86674
- test_file: jstests/core/timeseries/timeseries_groupby_reorder.js
ticket: SERVER-87961
- test_file: jstests/core/timeseries/timeseries_lastpoint.js
ticket: SERVER-87961
- test_file: jstests/core/query/in_expression_plan_cache.js
ticket: SERVER-83712
- test_file: jstests/core/index/index_count_scan.js
ticket: SERVER-90461
- test_file: jstests/core/timeseries/bucket_unpacking_with_sort_negative.js
ticket: SERVER-90833
- test_file: jstests/aggregation/match_swapping_renamed_fields.js
ticket: SERVER-90869
- test_file: jstests/sharding/updateOne_without_shard_key/write_without_shard_key_single_shard_data_placement_change.js
ticket: SERVER-91114
- test_file: jstests/aggregation/sources/redact/root_redact.js
ticket: SERVER-91339
- test_file: jstests/core/timeseries/timeseries_shadowing_meta_project_pushdown.js
ticket: SERVER-90995
- test_file: jstests/core/timeseries/timeseries_cursor_batches.js
ticket: SERVER-91512
- test_file: jstests/change_streams/split_large_event.js
ticket: SERVER-91406
- test_file: jstests/core/sparse_index_supports_ne_null.js
ticket: SERVER-37164
- test_file: jstests/aggregation/bugs/add_fields_adds_to_missing_fields.js
ticket: SERVER-91784
- test_file: jstests/sharding/query/find_initialize_runtime_variables.js
ticket: SERVER-88647
- test_file: jstests/core/query/plan_cache/match_or_duplicate_predicate_plan_cache.js
ticket: SERVER-92603
- test_file: jstests/replsets/backwards_compatible_timeseries_catalog_options.js
ticket: SERVER-91195
- test_file: jstests/change_streams/timeseries.js
ticket: SERVER-91195
- test_file: jstests/core/timeseries/timeseries_insert_mixed_schema_bucket.js
ticket: SERVER-93099
- test_file: jstests/core/timeseries/timeseries_update_mixed_schema_bucket.js
ticket: SERVER-93099
suites: null
last-lts:
all:
- test_file: jstests/replsets/ignore_dbcheck_in_startup_recovery.js
ticket: SERVER-30832
- test_file: jstests/core/write/update/upsert_nor.js
ticket: SERVER-91700
- test_file: jstests/replsets/ignore_dbcheck_in_rollback.js
ticket: SERVER-30832
- test_file: jstests/replsets/ignore_dbcheck_in_initial_sync.js
ticket: SERVER-80340
- test_file: jstests/replsets/dbcheck_skip_applying_batch_on_secondary_parameter.js
ticket: SERVER-88885
- test_file: jstests/sharding/config_shards_on_repl_set_changes.js
ticket: SERVER-21185
- test_file: jstests/core/query/null_query_semantics.js
@ -618,6 +718,8 @@ last-lts:
ticket: SERVER-50792
- test_file: jstests/sharding/refine_collection_shard_key_basic.js
ticket: SERVER-50792
- test_file: jstests/core/index/elemmatch_index.js
ticket: SERVER-90747
- test_file: jstests/replsets/node_restarts_no_oplog_entry_at_stable.js
ticket: SERVER-51049
- test_file: jstests/replsets/awaitable_hello_errors_on_horizon_change.js
@ -1015,7 +1117,7 @@ last-lts:
- test_file: jstests/sharding/query/sharded_lookup_execution.js
ticket: SERVER-77427
- test_file: jstests/sharding/multi_collection_transaction_placement_conflict_workaround.js
ticket: SERVER-82353
ticket: SERVER-86583
- test_file: jstests/sharding/fsync_lock_unlock.js
ticket: SERVER-73685
- test_file: jstests/sharding/fsync_lock_ddl_lock.js
@ -1180,12 +1282,86 @@ last-lts:
ticket: SERVER-84130
- test_file: jstests/noPassthrough/disallow_new_transactions_at_shutdown_on_mongos.js
ticket: SERVER-77667
- test_file: jstests/core/timeseries/timeseries_collmod.js
ticket: SERVER-83370
- test_file: jstests/core/timeseries/timeseries_lookup.js
ticket: SERVER-79637
- test_file: jstests/core/notablescan.js
- test_file: jstests/noPassthrough/notablescan.js
ticket: SERVER-83119
- test_file: jstests/sharding/clustered_coll_scan.js
ticket: SERVER-83119
- test_file: jstests/sharding/eof_plan.js
ticket: SERVER-83119
- test_file: jstests/core/command_let_variables_expressions.js
ticket: SERVER-89268
- test_file: jstests/sharding/analyze_shard_key/sample_write_queries_sharded.js
ticket: SERVER-89268
- test_file: jstests/sharding/analyze_shard_key/sample_write_queries_unsharded.js
ticket: SERVER-89268
- test_file: jstests/change_streams/split_large_event_with_other_stages.js
ticket: SERVER-85848
- test_file: jstests/sharding/timeseries_drop.js
ticket: SERVER-84589
- test_file: jstests/core/query/bittest.js
ticket: SERVER-86419
- test_file: jstests/core/timeseries/timeseries_project.js
ticket: SERVER-87987
- test_file: jstests/core/administrative/apply_ops/apply_ops1.js
ticket: SERVER-82349
- test_file: jstests/sharding/swallow_unnecessary_uuid_mismatch_error.js
ticket: SERVER-79049
- test_file: jstests/sharding/view_query_readConcern_available.js
ticket: SERVER-86667
- test_file: jstests/replsets/reconstruct_prepared_transactions_initial_sync.js
ticket: SERVER-89618
- test_file: jstests/core/timeseries/timeseries_computed_field.js
ticket: SERVER-88072
- test_file: jstests/core/timeseries/timeseries_geonear_lookup.js
ticket: SERVER-81454
- test_file: jstests/sharding/move_chunk_deferred_lookup.js
ticket: SERVER-89859
- test_file: jstests/sharding/secondaries_clear_filtering_metadata.js
ticket: SERVER-86669
- test_file: jstests/aggregation/group_by_objectid.js
ticket: SERVER-90173
- test_file: jstests/replsets/catchup_ignores_old_heartbeats.js
ticket: SERVER-86674
- test_file: jstests/core/timeseries/timeseries_groupby_reorder.js
ticket: SERVER-87961
- test_file: jstests/core/timeseries/timeseries_lastpoint.js
ticket: SERVER-87961
- test_file: jstests/core/query/in_expression_plan_cache.js
ticket: SERVER-83712
- test_file: jstests/core/timeseries/bucket_unpacking_with_sort_negative.js
ticket: SERVER-90833
- test_file: jstests/sharding/direct_shard_connection_auth.js
ticket: SERVER-89994
- test_file: jstests/aggregation/match_swapping_renamed_fields.js
ticket: SERVER-90869
- test_file: jstests/sharding/updateOne_without_shard_key/write_without_shard_key_single_shard_data_placement_change.js
ticket: SERVER-91114
- test_file: jstests/aggregation/sources/redact/root_redact.js
ticket: SERVER-91339
- test_file: jstests/core/timeseries/timeseries_shadowing_meta_project_pushdown.js
ticket: SERVER-90995
- test_file: jstests/core/timeseries/timeseries_cursor_batches.js
ticket: SERVER-91512
- test_file: jstests/change_streams/split_large_event.js
ticket: SERVER-91406
- test_file: jstests/core/sparse_index_supports_ne_null.js
ticket: SERVER-37164
- test_file: jstests/aggregation/bugs/add_fields_adds_to_missing_fields.js
ticket: SERVER-91784
- test_file: jstests/sharding/query/find_initialize_runtime_variables.js
ticket: SERVER-88647
- test_file: jstests/core/query/plan_cache/match_or_duplicate_predicate_plan_cache.js
ticket: SERVER-92603
- test_file: jstests/replsets/backwards_compatible_timeseries_catalog_options.js
ticket: SERVER-91195
- test_file: jstests/change_streams/timeseries.js
ticket: SERVER-91195
- test_file: jstests/core/timeseries/timeseries_insert_mixed_schema_bucket.js
ticket: SERVER-93099
- test_file: jstests/core/timeseries/timeseries_update_mixed_schema_bucket.js
ticket: SERVER-93099
suites: null

View File

@ -13,29 +13,29 @@ include:
- filename: etc/evergreen_yml_components/variants/misc/task_generation.yml
### Uncomment when using this file for a LTS or Rapid release branch. ###
# - filename: etc/evergreen_yml_components/variants/misc/misc.yml
- filename: etc/evergreen_yml_components/variants/misc/misc.yml
- filename: etc/evergreen_yml_components/variants/amazon/test_release.yml
### Uncomment when using this file for a LTS or Rapid release branch. ###
# - filename: etc/evergreen_yml_components/variants/amazon/test_dev.yml
- filename: etc/evergreen_yml_components/variants/amazon/test_dev.yml
- filename: etc/evergreen_yml_components/variants/atlas/test_release.yml
- filename: etc/evergreen_yml_components/variants/debian/test_release.yml
### Comment out when using this file for a Rapid release branch. ###
- filename: etc/evergreen_yml_components/variants/ibm/test_release_master_and_lts_branches_only.yml
# - filename: etc/evergreen_yml_components/variants/ibm/test_release_master_and_lts_branches_only.yml
- filename: etc/evergreen_yml_components/variants/macos/test_release.yml
- filename: etc/evergreen_yml_components/variants/rhel/test_release.yml
### Uncomment when using this file for a LTS or Rapid release branch. ###
# - filename: etc/evergreen_yml_components/variants/rhel/test_dev.yml
- filename: etc/evergreen_yml_components/variants/rhel/test_dev.yml
### Uncomment when using this file for a LTS release branch. ###
# - filename: etc/evergreen_yml_components/variants/rhel/test_dev_master_and_lts_branches_only.yml
### Uncomment when using this file for a LTS or Rapid release branch. ###
# - filename: etc/evergreen_yml_components/variants/sanitizer/test_dev.yml
- filename: etc/evergreen_yml_components/variants/sanitizer/test_dev.yml
- filename: etc/evergreen_yml_components/variants/suse/test_release.yml
@ -43,7 +43,7 @@ include:
- filename: etc/evergreen_yml_components/variants/windows/test_release.yml
### Uncomment when using this file for a LTS or Rapid release branch. ###
# - filename: etc/evergreen_yml_components/variants/windows/test_dev.yml
- filename: etc/evergreen_yml_components/variants/windows/test_dev.yml
### Uncomment when using this file for a LTS release branch. ###
# - filename: etc/evergreen_yml_components/variants/windows/test_dev_master_and_lts_branches_only.yml

View File

@ -11,6 +11,12 @@
overrides:
# We increased the timeout since comparison results speed were slowed down due to resolving
# Object.entries correctly.
enterprise-amazon-linux2-arm64-all-feature-flags-fuzzers:
- task: aggregation_timeseries_fuzzer
exec_timeout: 150 # 2.5 hours
enterprise-macos:
- task: replica_sets_jscore_passthrough
exec_timeout: 150 # 2.5 hours
@ -20,7 +26,7 @@ overrides:
exec_timeout: 150 # 2.5 hours
# TODO: Delete me once all tests have been migrated over from complete-tsan
enterprise-rhel80-debug-complete-tsan:
enterprise-rhel8-debug-complete-tsan:
- task: shard_merge_jscore_passthrough
exec_timeout: 240 # 4 hours
- task: shard_merge_causally_consistent_jscore_passthrough
@ -38,7 +44,7 @@ overrides:
- task: sharding_max_mirroring_opportunistic_secondary_targeting_ese_gcm
exec_timeout: 180 # 3 hours
enterprise-rhel80-debug-tsan:
enterprise-rhel8-debug-tsan:
- task: aggregation_expression_multiversion_fuzzer
exec_timeout: 600 # 10 hours
- task: aggregation_multiversion_fuzzer
@ -76,23 +82,29 @@ overrides:
- task: replica_sets_jscore_passthrough
exec_timeout: 150 # 2.5 hours
rhel80-asan:
rhel8-asan:
- task: aggregation_timeseries_fuzzer
exec_timeout: 150 # 2.5 hours
exec_timeout: 360 # 6 hours
- task: aggregation_wildcard_fuzzer
exec_timeout: 300 # 5 hours
- task: aggregation_multiversion_fuzzer_last_continuous
exec_timeout: 300 # 5 hours
- task: aggregation_multiversion_fuzzer_last_lts
exec_timeout: 300 # 5 hours
rhel80-debug-ubsan:
rhel8-debugubsan:
- task: update_timeseries_fuzzer
exec_timeout: 150 # 2.5 hours
rhel80-debug-ubsan-classic-engine:
rhel8-debugubsan-classic-engine:
- task: update_timeseries_fuzzer
exec_timeout: 150 # 2.5 hours
rhel80-debug-aubsan-all-feature-flags:
rhel8-debugaubsan-all-feature-flags:
- task: update_timeseries_fuzzer
exec_timeout: 180 # 3 hours
rhel80-debug-aubsan-classic-engine:
rhel8-debugaubsan-classic-engine:
- task: update_timeseries_fuzzer
exec_timeout: 180 # 3 hours

View File

@ -73,7 +73,7 @@ modules:
- name: enterprise
repo: git@github.com:10gen/mongo-enterprise-modules.git
prefix: src/mongo/db/modules
branch: master
branch: v7.3
- name: wtdevelop
repo: git@github.com:wiredtiger/wiredtiger.git
@ -151,6 +151,7 @@ post:
- func: "cleanup FUSE watchdog"
- func: "cleanup environment"
- func: "cleanup jepsen docker test"
- func: "cleanup external auth test artifacts"
# Timeout steps
timeout:

View File

@ -158,13 +158,13 @@ variables:
- enterprise-rhel-70-64-bit
- enterprise-rhel-81-ppc64le
- ubi8
- rhel80
- rhel-82-arm64
- rhel8
- rhel8-arm64
- rhel90
- rhel90-arm64
- enterprise-rhel-80-64-bit
- enterprise-rhel-80-64-bit-suggested # For testing selinux.
- enterprise-rhel-82-arm64
- enterprise-rhel-8-64-bit
- enterprise-rhel-8-64-bit-suggested # For testing selinux.
- enterprise-rhel8-arm64
- enterprise-rhel-83-s390x
- enterprise-rhel-90-64-bit
- enterprise-rhel-90-arm64
@ -354,6 +354,19 @@ functions:
- "--change-dir=${extraction_change_dir}"
- "${move_outputs}"
"extract benchmarks": &extract_benchmarks
command: subprocess.exec
display_name: "extract benchmarks"
params:
binary: bash
args:
- "src/evergreen/run_python_script.sh"
- "evergreen/functions/binaries_extract.py"
- "--tarball=mongo_benchmarks.tgz"
- "--extraction-command=${decompress}"
- "--change-dir=build/install"
- "--move-output=build/install/benchmarks.txt:build/"
"get version expansions": &get_version_expansions
command: s3.get
params:
@ -377,9 +390,9 @@ functions:
params:
aws_key: ${aws_key}
aws_secret: ${aws_secret}
remote_file: ${project}/${build_variant}/${revision}/benchmarks/${build_id}.tgz
remote_file: ${mongo_benchmarks}
bucket: mciuploads
extract_to: src
local_file: src/mongo_benchmarks.tgz
"fetch corpus": &fetch_corpus
command: s3.get
@ -430,7 +443,7 @@ functions:
"get buildnumber": &get_buildnumber
command: keyval.inc
params:
key: "${build_variant}_master"
key: "${build_variant}_${project}"
destination: "builder_num"
"run diskstats": &run_diskstats
@ -605,6 +618,10 @@ functions:
value: ${project}/${compile_variant}/${version_id}/binaries/mongo-jstestshell-debugsymbols-${revision_order_id}.tgz
- key: mongo_artifacts
value: ${project}/${compile_variant}/${version_id}/artifacts/${revision_order_id}.tgz
- key: mongo_benchmarks
value: ${project}/${compile_variant}/${version_id}/binaries/benchmarks-${revision_order_id}.${ext|tgz}
- key: mongo_benchmarks_debugsymbols
value: ${project}/${compile_variant}/${version_id}/binaries/benchmarksdebugsymbols-${revision_order_id}.${ext|tgz}
- key: mongo_venv
value: ${project}/${compile_variant}/${version_id}/venv/${revision_order_id}.tgz
- key: mongo_fuzzer_corpus_mciuploads
@ -767,6 +784,7 @@ functions:
- *f_expansions_write
- *set_up_credentials
- *fetch_benchmarks
- *extract_benchmarks
"f_multiversion_setup_exec": &do_multiversion_setup
command: subprocess.exec
@ -2451,6 +2469,14 @@ functions:
args:
- "./src/evergreen/antithesis_image_build_and_push.sh"
"cleanup external auth test artifacts":
- *f_expansions_write
- command: subprocess.exec
params:
binary: bash
args:
- "./src/evergreen/sasl_windows_cyrussasl_teardown.sh"
#######################################
# Tasks #
@ -2559,6 +2585,20 @@ tasks:
vars:
suite: multiversion_future_git_tag
- <<: *task_template
name: sasl_windows_cyrussasl
tags: ["assigned_to_jira_team_server_security", "sasl", "experimental"]
commands:
- func: "f_expansions_write"
- func: "do setup"
- func: "f_expansions_write"
- command: subprocess.exec
params:
binary: bash
args:
- "src/evergreen/sasl_windows_cyrussasl_setup.sh"
- func: "run tests"
- <<: *task_template
name: jsCore
tags: ["jscore", "common"]

File diff suppressed because it is too large Load Diff

View File

@ -148,10 +148,10 @@ variables:
- enterprise-macos-arm64
- enterprise-rhel-70-64-bit
- enterprise-rhel-81-ppc64le
- enterprise-rhel-80-64-bit
- enterprise-rhel-80-64-bit-coverage
- enterprise-rhel-80-64-bit-suggested
- enterprise-rhel-82-arm64
- enterprise-rhel-8-64-bit
- enterprise-rhel-8-64-bit-coverage
- enterprise-rhel-8-64-bit-suggested
- enterprise-rhel8-arm64
- enterprise-rhel-83-s390x
- enterprise-rhel-90-64-bit
- enterprise-rhel-90-arm64
@ -424,31 +424,43 @@ tasks:
commands:
- func: "scons compile"
vars:
targets: install-benchmarks
targets: >-
install-benchmarks
archive-benchmarks
compiling_for_test: true
- command: archive.targz_pack
params:
target: "benchmarks.tgz"
source_dir: "src"
include:
- "./build/benchmarks.txt"
- "./build/**_bm"
- "./build/**_bm.gcno"
- "./build/**_bm.exe"
- "./build/**_bm.pdb"
- "./build/**.so"
- "./build/**.debug"
- command: s3.put
params:
aws_key: ${aws_key}
aws_secret: ${aws_secret}
local_file: benchmarks.tgz
remote_file: ${project}/${build_variant}/${revision}/benchmarks/${build_id}.tgz
local_file: src/benchmarks.${ext|tgz}
remote_file: ${mongo_benchmarks}
bucket: mciuploads
permissions: public-read
content_type: application/tar
display_name: Benchmarks
- name: compile_upload_benchmarks_debug
tags: ["assigned_to_jira_team_devprod_build"]
depends_on:
- name: compile_upload_benchmarks
commands:
- func: "scons compile"
vars:
targets: >-
install-benchmarks-debug
archive-benchmarks-debug
compiling_for_test: true
- command: s3.put
params:
aws_key: ${aws_key}
aws_secret: ${aws_secret}
local_file: src/benchmarks-debugsymbols.${ext|tgz}
remote_file: ${mongo_benchmarks_debugsymbols}
bucket: mciuploads
permissions: public-read
content_type: application/tar
display_name: Benchmarks Debug
- &archive_dist_test
name: archive_dist_test
tags: ["assigned_to_jira_team_devprod_build"]
@ -909,6 +921,86 @@ tasks:
targets: install-unittests install-unittests-debug
compiling_for_test: true
- name: compile_and_run_unittests_first_quarter
exec_timeout_secs: 21600 # 6 hours
depends_on:
- name: compile_dist_test
commands:
- func: "scons compile"
vars:
targets: install-first-quarter-unittests install-first-quarter-unittests-debug
compiling_for_test: true
- func: "f_expansions_write"
- func: "run diskstats"
- func: "f_expansions_write"
- func: "monitor process threads"
- func: "collect system resource info"
- func: "run tests"
vars:
suite: unittests_first_quarter
install_dir: build/install/bin
exec_timeout_secs: 21600 # 6 hours
- name: compile_and_run_unittests_second_quarter
exec_timeout_secs: 21600 # 6 hours
depends_on:
- name: compile_dist_test
commands:
- func: "scons compile"
vars:
targets: install-second-quarter-unittests install-second-quarter-unittests-debug
compiling_for_test: true
- func: "f_expansions_write"
- func: "run diskstats"
- func: "f_expansions_write"
- func: "monitor process threads"
- func: "collect system resource info"
- func: "run tests"
vars:
suite: unittests_second_quarter
install_dir: build/install/bin
exec_timeout_secs: 21600 # 6 hours
- name: compile_and_run_unittests_third_quarter
exec_timeout_secs: 21600 # 6 hours
depends_on:
- name: compile_dist_test
commands:
- func: "scons compile"
vars:
targets: install-third-quarter-unittests install-third-quarter-unittests-debug
compiling_for_test: true
- func: "f_expansions_write"
- func: "run diskstats"
- func: "f_expansions_write"
- func: "monitor process threads"
- func: "collect system resource info"
- func: "run tests"
vars:
suite: unittests_third_quarter
install_dir: build/install/bin
exec_timeout_secs: 21600 # 6 hours
- name: compile_and_run_unittests_fourth_quarter
exec_timeout_secs: 21600 # 6 hours
depends_on:
- name: compile_dist_test
commands:
- func: "scons compile"
vars:
targets: install-fourth-quarter-unittests install-fourth-quarter-unittests-debug
compiling_for_test: true
- func: "f_expansions_write"
- func: "run diskstats"
- func: "f_expansions_write"
- func: "monitor process threads"
- func: "collect system resource info"
- func: "run tests"
vars:
suite: unittests_fourth_quarter
install_dir: build/install/bin
exec_timeout_secs: 21600 # 6 hours
- <<: *compile_unittests
name: compile_unittests_future_git_tag_multiversion
depends_on:
@ -1274,7 +1366,6 @@ tasks:
- func: "scons compile"
vars:
targets: >-
distsrc-${ext|tgz}
archive-dist
archive-dist-debug
archive-jstestshell
@ -1296,20 +1387,6 @@ tasks:
binary: bash
args:
- "src/evergreen/package.sh"
- command: s3.put
params:
aws_key: ${aws_key}
aws_secret: ${aws_secret}
local_file: src/distsrc.${ext|tgz}
remote_file: ${project}/${build_variant}/${revision}/sources/mongo-src-${build_id}.${ext|tgz}
bucket: mciuploads
permissions: public-read
content_type: ${content_type|application/gzip}
display_name: Source tarball
# We only need to upload the source tarball from one of the build variants
# because it should be the same everywhere, so just use rhel70/rhel80/windows.
# TODO(SERVER-80479): remove rhel70 when support for it has been dropped.
build_variants: [rhel70, rhel80, windows]
- command: s3.put
params:
optional: true
@ -1428,6 +1505,7 @@ tasks:
- command: shell.exec
params:
shell: bash
silent: true
script: |
set -oe
echo "${release_tools_container_registry_password}" | podman login --password-stdin --username ${release_tools_container_registry_username} ${release_tools_container_registry}
@ -1474,17 +1552,6 @@ tasks:
local_file: src/mongo-cryptd.tgz
build_variants: *mongocryptd_variants
# Fetch the sources (on relevant variants only)
- command: s3.get
params:
aws_key: ${aws_key}
aws_secret: ${aws_secret}
remote_file: ${project}/${build_variant}/${revision}/sources/mongo-src-${build_id}.${ext|tgz}
bucket: mciuploads
local_file: src/distsrc.${ext|tgz}
# We only need to upload the source tarball from one of the build variants
# because it should be the same everywhere, so just use rhel70/rhel80/windows.
# TODO(SERVER-80479): remove rhel70 when support for it has been dropped.
build_variants: [rhel70, rhel80, windows]
- func: "generate compile expansions"
- func: "apply compile expansions"
- func: "fetch dist debugsymbols"
@ -1498,6 +1565,7 @@ tasks:
- command: shell.exec
params:
shell: bash
silent: true
script: |
set -oe
echo "${release_tools_container_registry_password}" | podman login --password-stdin --username ${release_tools_container_registry_username} ${release_tools_container_registry}
@ -1537,21 +1605,6 @@ tasks:
content_type: ${content_type|application/gzip}
remote_file: ${push_path}-STAGE/${push_name}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}-${task_id}.${ext|tgz}
build_variants: *mongocryptd_variants
# Put the source tarball
- command: s3.put
params:
aws_secret: ${aws_secret}
local_file: src/mongodb-src-${src_suffix}.${ext|tar.gz}
aws_key: ${aws_key}
bucket: build-push-testing
permissions: public-read
content_type: ${content_type|application/gzip}
remote_file: ${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}
# We only need to upload the source tarball from one of the build variants
# because it should be the same everywhere, so just use rhel70/rhel80/windows.
# TODO(SERVER-80479): remove rhel70 when support for it has been dropped.
build_variants: [rhel70, rhel80, windows]
# Put the debug symbols
# push directly to repo due to limitations in file size SERVER-63432
- command: s3.put
@ -1588,21 +1641,6 @@ tasks:
remote_file: ${push_path}-STAGE/${push_name}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}-${task_id}.${ext|tgz}.sig
build_variants: *mongocryptd_variants
# Put the source tarball signature
- command: s3.put
params:
aws_secret: ${aws_secret}
local_file: src/mongodb-src-${src_suffix}.${ext|tar.gz}.sig
aws_key: ${aws_key}
bucket: build-push-testing
permissions: public-read
content_type: ${content_type|application/gzip}
remote_file: ${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}.sig
# We only need to upload the source tarball from one of the build variants
# because it should be the same everywhere, so just use rhel70/rhel80/windows.
# TODO(SERVER-80479): remove rhel70 when support for it has been dropped.
build_variants: [rhel70, rhel80, windows]
# Put the debug symbols signature
- command: s3.put
params:
@ -1650,21 +1688,6 @@ tasks:
remote_file: ${push_path}-STAGE/${push_name}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}-${task_id}.${ext|tgz}.sha1
build_variants: *mongocryptd_variants
# Put the source tarball sha1
- command: s3.put
params:
aws_secret: ${aws_secret}
local_file: src/mongodb-src-${src_suffix}.${ext|tar.gz}.sha1
aws_key: ${aws_key}
permissions: public-read
bucket: build-push-testing
content_type: text/plain
remote_file: ${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}.sha1
# We only need to upload the source tarball from one of the build variants
# because it should be the same everywhere, so just use rhel70/rhel80/windows.
# TODO(SERVER-80479): remove rhel70 when support for it has been dropped.
build_variants: [rhel70, rhel80, windows]
# Put the debug symbols sha1
- command: s3.put
params:
@ -1712,21 +1735,6 @@ tasks:
remote_file: ${push_path}-STAGE/${push_name}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}-${task_id}.${ext|tgz}.sha256
build_variants: *mongocryptd_variants
# Put the source tarball sha256
- command: s3.put
params:
aws_secret: ${aws_secret}
local_file: src/mongodb-src-${src_suffix}.${ext|tar.gz}.sha256
permissions: public-read
aws_key: ${aws_key}
bucket: build-push-testing
content_type: text/plain
remote_file: ${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}.sha256
# We only need to upload the source tarball from one of the build variants
# because it should be the same everywhere, so just use rhel70/rhel80/windows.
# TODO(SERVER-80479): remove rhel70 when support for it has been dropped.
build_variants: [rhel70, rhel80, windows]
# Put the debug symbols sha256
- command: s3.put
params:
@ -1774,21 +1782,6 @@ tasks:
remote_file: ${push_path}-STAGE/${push_name}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}-${task_id}.${ext|tgz}.md5
build_variants: *mongocryptd_variants
# Put the source tarball md5
- command: s3.put
params:
aws_secret: ${aws_secret}
local_file: src/mongodb-src-${src_suffix}.${ext|tar.gz}.md5
aws_key: ${aws_key}
bucket: build-push-testing
permissions: public-read
content_type: text/plain
remote_file: ${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}.md5
# We only need to upload the source tarball from one of the build variants
# because it should be the same everywhere, so just use rhel70/rhel80/windows.
# TODO(SERVER-80479): remove rhel70 when support for it has been dropped.
build_variants: [rhel70, rhel80, windows]
# Put the debug symbols md5
- command: s3.put
params:
@ -1889,11 +1882,6 @@ tasks:
'destination': {'path': '${push_path}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}.${ext|tgz}', 'bucket': '${push_bucket}'},
'build_variants': *mongocryptd_variants}
#Source tarball
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}', 'bucket': 'build-push-testing'},
'destination': {'path': 'src/mongodb-src-${src_suffix}.${ext|tar.gz}', 'bucket': '${push_bucket}'},
'build_variants': ['rhel70', 'windows']}
#MSI (Windows only)
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-${push_name}-${push_arch}-${suffix}-${task_id}-signed.msi', 'bucket': 'build-push-testing'},
'destination': {'path': '${push_path}/mongodb-${push_name}-${push_arch}-${suffix}-signed.msi', 'bucket': '${push_bucket}'},
@ -1908,11 +1896,6 @@ tasks:
'destination': {'path': '${push_path}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}.${ext|tgz}.sig', 'bucket': '${push_bucket}'},
'build_variants': *mongocryptd_variants}
#Source tarball signature
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}.sig', 'bucket': 'build-push-testing'},
'destination': {'path': 'src/mongodb-src-${src_suffix}.${ext|tar.gz}.sig', 'bucket': '${push_bucket}'},
'build_variants': ['rhel70', 'windows']}
#SHA1 for binaries
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-${push_name}-${push_arch}-${suffix}-${task_id}.${ext|tgz}.sha1', 'bucket': 'build-push-testing'},
'destination': {'path': '${push_path}/mongodb-${push_name}-${push_arch}-${suffix}.${ext|tgz}.sha1', 'bucket': '${push_bucket}'}}
@ -1922,11 +1905,6 @@ tasks:
'destination': {'path': '${push_path}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}.${ext|tgz}.sha1', 'bucket': '${push_bucket}'},
'build_variants': *mongocryptd_variants}
#SHA1 for source tarball
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}.sha1', 'bucket': 'build-push-testing'},
'destination': {'path': 'src/mongodb-src-${src_suffix}.${ext|tar.gz}.sha1', 'bucket': '${push_bucket}'},
'build_variants': ['rhel70', 'windows']}
#SHA1 for MSI
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-${push_name}-${push_arch}-${suffix}-${task_id}-signed.msi.sha1', 'bucket': 'build-push-testing'},
'destination': {'path': '${push_path}/mongodb-${push_name}-${push_arch}-${suffix}-signed.msi.sha1', 'bucket': '${push_bucket}'},
@ -1941,11 +1919,6 @@ tasks:
'destination': {'path': '${push_path}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}.${ext|tgz}.sha256', 'bucket': '${push_bucket}'},
'build_variants': *mongocryptd_variants}
#SHA256 for source tarball
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}.sha256', 'bucket': 'build-push-testing'},
'destination': {'path': 'src/mongodb-src-${src_suffix}.${ext|tar.gz}.sha256', 'bucket': '${push_bucket}'},
'build_variants': ['rhel70', 'windows']}
#SHA256 for MSI files
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-${push_name}-${push_arch}-${suffix}-${task_id}-signed.msi.sha256', 'bucket': 'build-push-testing'},
'destination': {'path': '${push_path}/mongodb-${push_name}-${push_arch}-${suffix}-signed.msi.sha256', 'bucket': '${push_bucket}'},
@ -1960,11 +1933,6 @@ tasks:
'destination': {'path': '${push_path}/mongodb-cryptd-${push_name}-${push_arch}-${suffix}.${ext|tgz}.md5', 'bucket': '${push_bucket}'},
'build_variants': *mongocryptd_variants}
#MD5 for source tarball
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-src-${src_suffix}-${task_id}.${ext|tar.gz}.md5', 'bucket': 'build-push-testing'},
'destination': {'path': 'src/mongodb-src-${src_suffix}.${ext|tar.gz}.md5', 'bucket': '${push_bucket}'},
'build_variants': ['rhel70', 'windows']}
#MD5 for MSIs
- {'source': {'path': '${push_path}-STAGE/${push_name}/mongodb-${push_name}-${push_arch}-${suffix}-${task_id}-signed.msi.md5', 'bucket': 'build-push-testing'},
'destination': {'path': '${push_path}/mongodb-${push_name}-${push_arch}-${suffix}-signed.msi.md5', 'bucket': '${push_bucket}'},
@ -2036,6 +2004,7 @@ tasks:
- command: shell.exec
params:
shell: bash
silent: true
script: |
set -oe
echo "${release_tools_container_registry_password}" | podman login --password-stdin --username ${release_tools_container_registry_username} ${release_tools_container_registry}
@ -2227,6 +2196,7 @@ task_groups:
name: compile_upload_benchmarks_TG
tasks:
- compile_upload_benchmarks
- compile_upload_benchmarks_debug
- <<: *compile_task_group_template
name: compile_and_archive_dist_test_TG
@ -2318,12 +2288,9 @@ task_groups:
- compile_dist_test
- archive_dist_test
- archive_dist_test_debug
- compile_unittests
- run_unittests
- compile_dbtest
- run_dbtest
- archive_dbtest
- compile_all
- <<: *compile_task_group_template
name: compile_test_serial_future_git_tag_multiversion_TG
@ -2344,12 +2311,9 @@ task_groups:
- compile_dist_test
- archive_dist_test
- archive_dist_test_debug
- compile_unittests
- run_unittests
- compile_dbtest
- run_dbtest
- archive_dbtest
- compile_all
- package
# The *no_unittests_TG taskgroups are useful for static builds,
@ -2404,28 +2368,11 @@ task_groups:
- compile_dist_test
- archive_dist_test
- archive_dist_test_debug
- compile_unittests
- run_unittests
- compile_dbtest
- run_dbtest
- archive_dbtest
- compile_upload_benchmarks
- compile_all
- <<: *compile_task_group_template
name: compile_test_benchmark_and_package_serial_TG
tasks:
- compile_dist_test
- archive_dist_test
- archive_dist_test_debug
- compile_unittests
- run_unittests
- compile_dbtest
- run_dbtest
- archive_dbtest
- compile_upload_benchmarks
- compile_all
- package
- compile_upload_benchmarks_debug
# The *no_unittests_TG taskgroups are useful for static builds,
# were the static binaries of the unittests can take up to
@ -2440,18 +2387,18 @@ task_groups:
- run_dbtest
- archive_dbtest
- compile_upload_benchmarks
- compile_upload_benchmarks_debug
- compile_all_but_not_unittests
- package
- <<: *compile_task_group_template
name: compile_and_test_TG
name: compile_test_parallel_unittest_stream_TG
max_hosts: -1
tasks:
- compile_dist_test
- compile_unittests
- run_unittests
- compile_dbtest
- run_dbtest
- compile_all
- compile_and_run_unittests_first_quarter
- compile_and_run_unittests_second_quarter
- compile_and_run_unittests_third_quarter
- compile_and_run_unittests_fourth_quarter
# These `parallel` task groups are only appropriate for builders that
# use --link-model=dynamic, and have scons_cache_scope: shared and
@ -2469,29 +2416,7 @@ task_groups:
- determine_patch_tests
- archive_dist_test
- archive_dist_test_debug
- compile_all
- <<: *compile_task_group_template
name: compile_test_and_package_parallel_core_stream_TG
tasks:
- compile_dist_test
- determine_patch_tests
- archive_dist_test
- archive_dist_test_debug
- compile_all
- package
- <<: *compile_task_group_template
name: compile_test_parallel_unittest_stream_TG
tasks:
- compile_unittests
- run_unittests
#- <<: *compile_task_group_template
# name: compile_test_parallel_unittest_stream_with_recording_TG
# tasks:
# - compile_unittests_for_recorded_unittest
# - run_unittests_with_recording
- compile_all_but_not_unittests
- <<: *compile_task_group_template
name: compile_test_parallel_dbtest_stream_TG

View File

@ -928,7 +928,7 @@ tasks:
- func: "run selinux tests"
vars:
user: root
distro: rhel76-selinux
distro: rhel79-selinux
test_list: jstests/selinux/*.js src/mongo/db/modules/enterprise/jstests/selinux/*.js
- name: selinux_rhel7_org
@ -947,7 +947,7 @@ tasks:
- func: "run selinux tests"
vars:
user: root
distro: rhel76-selinux
distro: rhel79-selinux
test_list: jstests/selinux/*.js
- name: selinux_rhel8_enterprise

View File

@ -1109,7 +1109,6 @@ tasks:
sharded_collections_jscore_passthrough_last_lts_new_old_old_new: last_lts
- func: "generate resmoke tasks"
vars:
suite: sharded_collections_jscore_passthrough
run_no_feature_flag_tests: "true"
- <<: *gen_task_template
@ -1234,7 +1233,6 @@ tasks:
sharding_jscore_passthrough_last_continuous_new_old_old_new: last_continuous
- func: "generate resmoke tasks"
vars:
suite: sharding_jscore_passthrough
run_no_feature_flag_tests: "true"
- <<: *gen_task_template
@ -1289,7 +1287,6 @@ tasks:
- func: "generate resmoke tasks"
vars:
use_large_distro: "true"
suite: sharding
run_no_feature_flag_tests: "true"
- <<: *jstestfuzz_template
@ -1626,7 +1623,6 @@ tasks:
<<: *jstestfuzz_config_vars
jstestfuzz_vars: --jsTestsDir ../jstests
resmoke_args: "--mongodSetParameters='{logComponentVerbosity: {command: 2}}'"
suite: jstestfuzz_sharded
npm_command: jstestfuzz
run_no_feature_flag_tests: "true"

View File

@ -289,7 +289,6 @@ tasks:
concurrency_replication_last_lts_old_new_new: last_lts
- func: "generate resmoke tasks"
vars:
suite: concurrency_replication
run_no_feature_flag_tests: "true"
- <<: *gen_task_template
@ -365,7 +364,6 @@ tasks:
concurrency_sharded_replication_last_lts_new_old_old_new: last_lts
- func: "generate resmoke tasks"
vars:
suite: concurrency_sharded_replication
run_no_feature_flag_tests: "true"
- <<: *gen_task_template
@ -456,7 +454,6 @@ tasks:
num_tasks: 5
jstestfuzz_vars: --useEsModules
npm_command: initsync-fuzzer
suite: initial_sync_fuzzer
resmoke_args: "--mongodSetParameters='{logComponentVerbosity: {command: 2}}'"
run_no_feature_flag_tests: "true"
@ -609,7 +606,6 @@ tasks:
<<: *jstestfuzz_config_vars
jstestfuzz_vars: --jsTestsDir ../jstests
resmoke_args: "--mongodSetParameters='{logComponentVerbosity: {command: 2}}'"
suite: jstestfuzz_replication
npm_command: jstestfuzz
run_no_feature_flag_tests: "true"
@ -709,7 +705,6 @@ tasks:
replica_sets_jscore_passthrough_last_lts_old_new_new: last_lts
- func: "generate resmoke tasks"
vars:
suite: replica_sets_jscore_passthrough
run_no_feature_flag_tests: "true"
- <<: *gen_task_template
@ -790,7 +785,6 @@ tasks:
replica_sets_last_continuous: last_continuous
- func: "generate resmoke tasks"
vars:
suite: replica_sets
run_no_feature_flag_tests: "true"
- <<: *gen_task_template
@ -822,7 +816,7 @@ tasks:
- <<: *gen_task_template
name: replica_sets_uninitialized_fcv_jscore_passthrough_gen
tags: ["assigned_to_jira_team_server_repl", "replica_sets", "san", "large"]
tags: ["assigned_to_jira_team_server_repl", "replica_sets", "san", "large", "uninitialized_fcv"]
commands:
- func: "generate resmoke tasks"
@ -893,7 +887,6 @@ tasks:
num_tasks: 5
jstestfuzz_vars: --useEsModules
npm_command: rollback-fuzzer
suite: rollback_fuzzer
# Rollback suites create indexes with majority of nodes not available for replication. So, disabling
# index build commit quorum.
resmoke_args: "--mongodSetParameters='{logComponentVerbosity: {command: 2}, enableIndexBuildCommitQuorum: false}'"
@ -924,9 +917,19 @@ tasks:
- <<: *gen_task_template
name: sharded_collections_uninitialized_fcv_jscore_passthrough_gen
tags: ["assigned_to_jira_team_server_repl", "sharding", "jscore", "initsync"]
tags: ["assigned_to_jira_team_server_repl", "sharding", "jscore", "initsync", "uninitialized_fcv"]
commands:
- func: "generate resmoke tasks"
vars:
use_large_distro: "true"
- <<: *gen_task_template
name: sharded_collections_txns_uninitialized_fcv_jscore_passthrough_gen
tags: ["assigned_to_jira_team_server_repl", "sharding", "jscore", "initsync", "uninitialized_fcv"]
commands:
- func: "generate resmoke tasks"
vars:
use_large_distro: "true"
- <<: *gen_task_template
name: sharding_api_version_jscore_passthrough_gen
@ -938,9 +941,19 @@ tasks:
- <<: *gen_task_template
name: sharding_uninitialized_fcv_jscore_passthrough_gen
tags: ["assigned_to_jira_team_server_repl", "sharding", "jscore", "common", "initsync"]
tags: ["assigned_to_jira_team_server_repl", "sharding", "jscore", "initsync", "uninitialized_fcv"]
commands:
- func: "generate resmoke tasks"
vars:
use_large_distro: "true"
- <<: *gen_task_template
name: sharding_txns_uninitialized_fcv_jscore_passthrough_gen
tags: ["assigned_to_jira_team_server_repl", "sharding", "jscore", "initsync", "uninitialized_fcv"]
commands:
- func: "generate resmoke tasks"
vars:
use_large_distro: "true"
- name: tla_plus
tags: ["assigned_to_jira_team_server_repl"]

View File

@ -247,13 +247,13 @@ tasks:
vars:
<<: *jstestfuzz_config_vars
# We have seen some common scenarios where the generated pipelines take a while to run and can
# hit some timeouts. We'll split 80000 pipelines across 80 files, compared to 80000 pipelines
# hit some timeouts. We'll split 70000 pipelines across 70 files, compared to 80000 pipelines
# across 20 files in the other generational agg fuzzers. This approach can be considered if we
# see similar timeouts elsewhere. It is not well understood whether/how we could pass
# 'numPipelines' as an argument in the yaml here, but it works as part of the
# 'jstestfuzz_vars' argument string. If a future reader better understands this evergreen
# integration, please update this comment and/or move numPipelines to a yaml arg here.
num_files: 80
num_files: 70
num_tasks: 20
jstestfuzz_vars: --diffTestingMode timeseries --numPipelines=1000
npm_command: agg-fuzzer
@ -263,7 +263,8 @@ tasks:
## Standalone fuzzer for checking wildcard index correctness ##
- <<: *jstestfuzz_template
name: aggregation_wildcard_fuzzer_gen
tags: ["assigned_to_jira_team_server_query_execution", "aggfuzzer", "common", "wildcard", "require_npm", "random_name"]
# TODO SERVER-85881: Re-enable wildcard fuzzers on debug builds by removing "no_debug_mode" tag.
tags: ["assigned_to_jira_team_server_query_execution", "aggfuzzer", "common", "wildcard", "require_npm", "random_name", "no_debug_mode"]
commands:
- func: "generate resmoke tasks"
vars:
@ -382,7 +383,6 @@ tasks:
change_streams_last_lts_old_new_new: last_lts
- func: "generate resmoke tasks"
vars:
suite: change_streams
run_no_feature_flag_tests: "true"
- <<: *task_template
@ -411,7 +411,6 @@ tasks:
change_streams_sharded_collections_passthrough_last_lts_new_old_old_new: last_lts
- func: "generate resmoke tasks"
vars:
suite: change_streams_sharded_collections_passthrough
run_no_feature_flag_tests: "true"
- <<: *task_template
@ -564,8 +563,8 @@ tasks:
- func: "generate resmoke tasks"
vars:
<<: *jstestfuzz_config_vars
num_files: 20
num_tasks: 20
num_files: 10
num_tasks: 40
jstestfuzz_vars: --useEsModules
npm_command: update-fuzzer
resmoke_args: "--mongodSetParameters='{logComponentVerbosity: {command: 2}}'"
@ -583,8 +582,8 @@ tasks:
- func: "generate resmoke tasks"
vars:
<<: *jstestfuzz_config_vars
num_files: 20
num_tasks: 20
num_files: 10
num_tasks: 40
jstestfuzz_vars: --useEsModules
npm_command: update-fuzzer
resmoke_args: "--mongodSetParameters='{logComponentVerbosity: {command: 2}}'"
@ -598,8 +597,8 @@ tasks:
- func: "generate resmoke tasks"
vars:
<<: *jstestfuzz_config_vars
num_files: 20
num_tasks: 20
num_files: 10
num_tasks: 40
jstestfuzz_vars: --diffTestingMode timeseries --useEsModules
npm_command: update-fuzzer
suite: generational_fuzzer

View File

@ -8,7 +8,7 @@ variables:
# ANY MODIFICATIONS HERE SHOULD ALSO BE MADE IN THOSE FILES
- &linux-arm64-dynamic-compile-params # Essential set of compile parameters used for Linux dev variants.
run_on:
- amazon2-arm64-large
- amazon2-arm64-latest-large
activate: true # These compile variants run on every commit to reduce latency of the auto-reverter.
modules:
- enterprise
@ -42,9 +42,32 @@ variables:
packager_arch: aarch64
packager_distro: amazon2
repo_edition: enterprise
large_distro_name: amazon2-arm64-large
large_distro_name: amazon2-arm64-latest-large
num_scons_link_jobs_available: 0.99
# THIS HAS COPIES IN:
# - etc/evergreen_yml_components/variants/amazon/test_dev_master_branch_only.yml
# - etc/evergreen_yml_components/variants/amazon/test_dev.yml
# ANY MODIFICATIONS HERE SHOULD ALSO BE MADE IN THOSE FILES
- &amazon_linux2_arm64_dynamic_compile_variant_dependency
depends_on:
- name: archive_dist_test_debug
variant: &amazon_linux2_arm64_dynamic_compile_variant_name amazon-linux2-arm64-dynamic-compile
- name: version_gen
variant: generate-tasks-for-version
# This is added because of EVG-18211.
# Without this we are adding extra dependencies on evergreen and it is causing strain
omit_generated_tasks: true
# - name: generate_buildid_to_debug_symbols_mapping
# variant: amazon-linux2-arm64-dynamic-compile
# THIS HAS COPIES IN:
# - etc/evergreen_yml_components/variants/amazon/test_dev_master_branch_only.yml
# - etc/evergreen_yml_components/variants/amazon/test_dev.yml
# ANY MODIFICATIONS HERE SHOULD ALSO BE MADE IN THOSE FILES
- &amazon_linux2_arm64_dynamic_expansions
<<: *linux_arm64_generic_expansions
compile_variant: *amazon_linux2_arm64_dynamic_compile_variant_name
buildvariants:
- <<: *linux-arm64-dynamic-compile-params
@ -67,7 +90,7 @@ buildvariants:
tasks:
- name: clang_tidy_TG
distros:
- amazon2-arm64-xlarge
- amazon2-arm64-latest-xlarge
- name: compile_ninja_quick_TG
- name: compile_test_parallel_unittest_stream_TG
- name: compile_test_parallel_core_stream_TG
@ -87,7 +110,7 @@ buildvariants:
modules:
- enterprise
run_on:
- amazon2-arm64-small
- amazon2-arm64-latest-small
stepback: false
expansions:
<<: *linux_arm64_generic_expansions
@ -123,7 +146,7 @@ buildvariants:
- amazon2-arm64-xlarge-commitqueue
- name: jsCore
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .lint
- name: test_api_version_compatibility
- name: validate_commit_message
@ -133,3 +156,59 @@ buildvariants:
- name: version_gen_validation
distros:
- ubuntu2004-small
- <<: *amazon_linux2_arm64_dynamic_compile_variant_dependency
name: amazon-linux2-arm64-try-sbe-engine
display_name: "Amazon Linux 2 arm64 Enterprise Query Patch Only (trySbeEngine)"
cron: "0 4 * * 0" # From the ${project_weekly_cron} parameter # This is a patch-only variant but we run on mainline to pick up task history.
run_on:
- amazon2-arm64-latest-small
stepback: true
expansions:
<<: *amazon_linux2_arm64_dynamic_expansions
# Diagnostic latches are disabled by default, and we match that behavior here. We also need to
# exclude tests with 'requires_latch_analyzer'.
compile_flags: >-
--use-diagnostic-latches=off
scons_cache_scope: shared
scons_cache_mode: all
has_packages: false
jstestfuzz_num_generated_files: 20
jstestfuzz_concurrent_num_files: 5
target_resmoke_time: 30
max_sub_suites: 3
idle_timeout_factor: 1.5
exec_timeout_factor: 1.5
test_flags: >-
--mongodSetParameters="{internalQueryFrameworkControl: trySbeEngine}"
--excludeWithAnyTags=resource_intensive,requires_latch_analyzer
tasks:
- name: aggregation_mongos_passthrough
- name: aggregation_sharded_collections_passthrough
- name: aggregation_one_shard_sharded_collections
- name: aggregation
- name: aggregation_disabled_optimization
- name: noPassthrough_gen
- name: noPassthroughWithMongod_gen
- name: jsCore
distros:
- amazon2-arm64-latest-large
- name: replica_sets_jscore_passthrough_gen
- name: sharded_collections_jscore_passthrough_gen
- name: sharding_jscore_passthrough_gen
- name: fcv_upgrade_downgrade_replica_sets_jscore_passthrough_gen
- name: fcv_upgrade_downgrade_sharding_jscore_passthrough_gen
- name: fcv_upgrade_downgrade_sharded_collections_jscore_passthrough_gen
- name: aggregation_repeat_queries
- name: burn_in_tests_gen
depends_on:
- name: version_burn_in_gen
variant: generate-tasks-for-version
omit_generated_tasks: true
- name: archive_dist_test_debug
variant: *amazon_linux2_arm64_dynamic_compile_variant_name
- name: multiversion_gen
- name: .multiversion_sanity_check
- name: concurrency_gen
- name: concurrency_replication_gen
- name: concurrency_sharded_replication_gen

View File

@ -8,7 +8,7 @@ variables:
# ANY MODIFICATIONS HERE SHOULD ALSO BE MADE IN THOSE FILES
- &linux-arm64-dynamic-compile-params # Essential set of compile parameters used for Linux dev variants.
run_on:
- amazon2-arm64-large
- amazon2-arm64-latest-large
activate: true # These compile variants run on every commit to reduce latency of the auto-reverter.
modules:
- enterprise
@ -30,6 +30,10 @@ variables:
--link-model=dynamic
--use-diagnostic-latches=on
# THIS HAS COPIES IN:
# - etc/evergreen_yml_components/variants/amazon/test_dev_master_branch_only.yml
# - etc/evergreen_yml_components/variants/amazon/test_dev.yml
# ANY MODIFICATIONS HERE SHOULD ALSO BE MADE IN THOSE FILES
- &amazon_linux2_arm64_dynamic_compile_variant_dependency
depends_on:
- name: archive_dist_test_debug
@ -54,9 +58,13 @@ variables:
packager_arch: aarch64
packager_distro: amazon2
repo_edition: enterprise
large_distro_name: amazon2-arm64-large
large_distro_name: amazon2-arm64-latest-large
num_scons_link_jobs_available: 0.99
# THIS HAS COPIES IN:
# - etc/evergreen_yml_components/variants/amazon/test_dev_master_branch_only.yml
# - etc/evergreen_yml_components/variants/amazon/test_dev.yml
# ANY MODIFICATIONS HERE SHOULD ALSO BE MADE IN THOSE FILES
- &amazon_linux2_arm64_dynamic_expansions
<<: *linux_arm64_generic_expansions
compile_variant: *amazon_linux2_arm64_dynamic_compile_variant_name
@ -104,7 +112,7 @@ buildvariants:
modules:
- enterprise
run_on:
- amazon2-arm64-small
- amazon2-arm64-latest-small
stepback: true
expansions: &enterprise-amazon-linux2-arm64-all-feature-flags-expansions
<<: *amazon_linux2_arm64_dynamic_expansions
@ -148,10 +156,10 @@ buildvariants:
- name: .config_fuzzer !.large
- name: .config_fuzzer .large
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .config_fuzzer_stress
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: disk_wiredtiger
- name: embedded_router_jscore_passthrough_gen
- name: embedded_router_jscore_passthrough_with_config_shard_gen
@ -201,7 +209,7 @@ buildvariants:
- name: sharding_jscore_passthrough_with_replica_set_endpoint_gen
- name: .serverless
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .timeseries_crud
- name: session_jscore_passthrough
- name: .shard_split
@ -242,7 +250,7 @@ buildvariants:
modules:
- enterprise
run_on:
- amazon2-arm64-small
- amazon2-arm64-latest-small
expansions:
<<: *amazon_linux2_arm64_dynamic_expansions
test_flags: >-
@ -283,10 +291,10 @@ buildvariants:
- name: .config_fuzzer !.large
- name: .config_fuzzer .large
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .config_fuzzer_stress
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: disk_wiredtiger
- name: .encrypt
- name: feature_flag_multiversion_gen
@ -325,7 +333,7 @@ buildvariants:
- name: secondary_reads_passthrough_gen
- name: .serverless
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .timeseries_crud
- name: session_jscore_passthrough
- name: .shard_split

View File

@ -6,7 +6,7 @@ buildvariants:
display_name: Amazon Linux 2
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
run_on:
- amazon2-test
- amazon2-latest-small
expansions:
test_flags: >-
--excludeWithAnyTags=SERVER-34286,incompatible_with_amazon_linux,requires_external_data_source,requires_latch_analyzer
@ -27,12 +27,12 @@ buildvariants:
packager_distro: amazon2
repo_edition: org
scons_cache_scope: shared
large_distro_name: amazon2-large
large_distro_name: amazon2-latest-large
compile_variant: amazon2
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-build
- amazon2-latest-large
- name: .aggfuzzer .common !.feature_flag_guarded
- name: aggregation !.feature_flag_guarded
- name: .auth !.audit !.multiversion
@ -67,7 +67,7 @@ buildvariants:
modules:
- enterprise
run_on:
- amazon2-test
- amazon2-latest-small
expansions:
additional_package_targets: >-
archive-mongocryptd
@ -99,7 +99,7 @@ buildvariants:
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-build
- amazon2-latest-large
- name: .aggfuzzer .common !.feature_flag_guarded
- name: aggregation !.feature_flag_guarded
- name: audit
@ -131,7 +131,7 @@ buildvariants:
display_name: "Amazon Linux 2 (openssl 1.1.1)"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
run_on:
- amazon2-openssl111-small
- amazon2-openssl111-latest-small
expansions:
test_flags: >-
--excludeWithAnyTags=SERVER-34286,incompatible_with_amazon_linux,requires_external_data_source,requires_latch_analyzer
@ -153,12 +153,12 @@ buildvariants:
packager_distro: amazon2
repo_edition: org
scons_cache_scope: shared
large_distro_name: amazon2-openssl111-large
large_distro_name: amazon2-openssl111-latest-large
compile_variant: amazon2-openssl111
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-openssl111-large
- amazon2-openssl111-latest-large
- name: .aggfuzzer .common !.feature_flag_guarded
- name: aggregation !.feature_flag_guarded
- name: .auth !.audit !.multiversion
@ -192,7 +192,7 @@ buildvariants:
modules:
- enterprise
run_on:
- amazon2-openssl111-small
- amazon2-openssl111-latest-small
expansions:
additional_package_targets: >-
archive-mongocryptd
@ -225,7 +225,7 @@ buildvariants:
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-openssl111-large
- amazon2-openssl111-latest-large
- name: .aggfuzzer .common !.feature_flag_guarded
- name: aggregation !.feature_flag_guarded
- name: audit
@ -256,7 +256,7 @@ buildvariants:
display_name: Amazon Linux 2 arm64
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
run_on:
- amazon2-arm64-small
- amazon2-arm64-latest-small
expansions:
push_path: linux
push_bucket: downloads.mongodb.org
@ -274,12 +274,12 @@ buildvariants:
packager_distro: amazon2
repo_edition: org
scons_cache_scope: shared
large_distro_name: amazon2-arm64-large
large_distro_name: amazon2-arm64-latest-large
compile_variant: amazon2-arm64
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: aggregation !.feature_flag_guarded
- name: .auth !.audit !.multiversion
- name: sharding_auth_gen
@ -287,7 +287,7 @@ buildvariants:
- name: .misc_js
- name: .concurrency .common
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: concurrency_replication_causal_consistency_gen
- name: disk_wiredtiger
- name: .jscore .common
@ -312,7 +312,7 @@ buildvariants:
modules:
- enterprise
run_on:
- amazon2-arm64-small
- amazon2-arm64-latest-small
expansions:
additional_package_targets: >-
archive-mongocryptd
@ -344,10 +344,10 @@ buildvariants:
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: compile_integration_and_test_parallel_stream_TG
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: test_api_version_compatibility
- name: .aggfuzzer !.feature_flag_guarded
- name: .aggregation !.feature_flag_guarded
@ -360,18 +360,18 @@ buildvariants:
- name: .concurrency !.large !.no_txns
- name: .concurrency .large !.no_txns
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .config_fuzzer !.large
- name: .config_fuzzer .large
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: disk_wiredtiger
- name: .encrypt
- name: idl_tests
- name: initial_sync_fuzzer_gen
- name: jsCore
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .jscore .common !jsCore !.feature_flag_guarded
- name: jsCore_min_batch_repeat_queries_ese_gsm
- name: jsCore_txns_large_txns_format
@ -383,17 +383,17 @@ buildvariants:
- name: .query_fuzzer !.feature_flag_guarded
- name: .read_write_concern .large
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .read_write_concern !.large
- name: .replica_sets !.encrypt !.auth
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: replica_sets_api_version_jscore_passthrough_gen
- name: replica_sets_reconfig_jscore_passthrough_gen
- name: retryable_writes_jscore_passthrough_gen
- name: retryable_writes_jscore_stepdown_passthrough_gen
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .read_only
- name: .rollbackfuzzer
- name: sasl
@ -409,16 +409,16 @@ buildvariants:
- name: .stitch
- name: .crypt
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: .publish_crypt
- name: secondary_reads_passthrough_gen
- name: server_discovery_and_monitoring_json_test_TG
- name: .serverless
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: server_selection_json_test_TG
distros:
- amazon2-arm64-large
- amazon2-arm64-latest-large
- name: test_packages
distros:
- ubuntu1804-arm64-build
@ -432,7 +432,7 @@ buildvariants:
display_name: Amazon Linux 2 arm64 (openssl 1.1.1)
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
run_on:
- amazon2-arm64-openssl111-small
- amazon2-arm64-openssl111-latest-small
expansions:
push_path: linux
push_bucket: downloads.mongodb.org
@ -451,12 +451,12 @@ buildvariants:
packager_distro: amazon2
repo_edition: org
scons_cache_scope: shared
large_distro_name: amazon2-arm64-openssl111-large
large_distro_name: amazon2-arm64-openssl111-latest-large
compile_variant: amazon2-arm64-openssl111
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: aggregation !.feature_flag_guarded
- name: .auth !.audit !.multiversion
- name: sharding_auth_gen
@ -464,7 +464,7 @@ buildvariants:
- name: .misc_js
- name: .concurrency .common
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: concurrency_replication_causal_consistency_gen
- name: disk_wiredtiger
- name: .jscore .common
@ -488,7 +488,7 @@ buildvariants:
modules:
- enterprise
run_on:
- amazon2-arm64-openssl111-small
- amazon2-arm64-openssl111-latest-small
expansions:
additional_package_targets: >-
archive-mongocryptd
@ -521,10 +521,10 @@ buildvariants:
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: compile_integration_and_test_parallel_stream_TG
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: test_api_version_compatibility
- name: .aggfuzzer !.feature_flag_guarded
- name: .aggregation !.feature_flag_guarded
@ -537,18 +537,18 @@ buildvariants:
- name: .concurrency !.large !.no_txns
- name: .concurrency .large !.no_txns
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: .config_fuzzer !.large
- name: .config_fuzzer .large
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: disk_wiredtiger
- name: .encrypt
- name: idl_tests
- name: initial_sync_fuzzer_gen
- name: jsCore
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: .jscore .common !jsCore !.feature_flag_guarded
- name: jsCore_min_batch_repeat_queries_ese_gsm
- name: jsCore_txns_large_txns_format
@ -560,17 +560,17 @@ buildvariants:
- name: .query_fuzzer !.feature_flag_guarded
- name: .read_write_concern .large
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: .read_write_concern !.large
- name: .replica_sets !.encrypt !.auth
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: replica_sets_api_version_jscore_passthrough_gen
- name: replica_sets_reconfig_jscore_passthrough_gen
- name: retryable_writes_jscore_passthrough_gen
- name: retryable_writes_jscore_stepdown_passthrough_gen
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: .read_only
- name: .rollbackfuzzer
- name: sasl
@ -586,16 +586,16 @@ buildvariants:
- name: .stitch
- name: .crypt
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: .publish_crypt
- name: secondary_reads_passthrough_gen
- name: server_discovery_and_monitoring_json_test_TG
- name: .serverless
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: server_selection_json_test_TG
distros:
- amazon2-arm64-openssl111-large
- amazon2-arm64-openssl111-latest-large
- name: test_packages
distros:
- ubuntu1804-arm64-build
@ -771,113 +771,6 @@ buildvariants:
- name: .publish
- name: generate_buildid_to_debug_symbols_mapping
# This variant is a special variant to test LTO.
# We just want it to bake for a while before considering that we turn it on by default.
- name: enterprise-amazon2023-lto
display_name: "Enterprise Amazon Linux 2023 LTO"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
modules:
- enterprise
run_on:
- amazon2023.0-small
expansions:
additional_package_targets: archive-mongocryptd archive-mongocryptd-debug
compile_flags: >-
--ssl
MONGO_DISTMOD=amazon2023
-j$(grep -c ^processor /proc/cpuinfo)
--variables-files=etc/scons/mongodbtoolchain_stable_gcc.vars
--lto
--linker=gold
--link-model=object
crypt_task_compile_flags: SHLINKFLAGS_EXTRA="-Wl,-Bsymbolic -Wl,--no-gnu-unique" CCFLAGS="-fno-gnu-unique"
# TODO BUILD-13887 should fix uses_pykmip incompatibility.
test_flags: --excludeWithAnyTags=incompatible_with_amazon_linux,requires_ldap_pool,uses_pykmip,requires_v4_0,requires_external_data_source,requires_latch_analyzer
has_packages: true
multiversion_platform: amazon2023
multiversion_edition: enterprise
multiversion_architecture: x86_64
repo_edition: enterprise
scons_cache_scope: shared
compile_variant: enterprise-amazon2023-lto
large_distro_name: amazon2023.0-large
tasks:
- name: compile_test_and_package_serial_lto_no_unittests_TG
distros:
- amazon2023.0-large
- name: test_api_version_compatibility
- name: .aggfuzzer !.feature_flag_guarded !.multiversion
- name: .aggregation !.feature_flag_guarded
- name: audit
- name: .auth !.multiversion
- name: .causally_consistent !.sharding
- name: .change_streams
- name: .change_stream_fuzzer
- name: .misc_js
- name: .concurrency !.large !.no_txns
- name: .concurrency .large !.no_txns
distros:
- amazon2023.0-large
- name: config_fuzzer_concurrency
- name: config_fuzzer_jsCore
- name: disk_wiredtiger
- name: .encrypt
- name: idl_tests
- name: initial_sync_fuzzer_gen
- name: jsCore
distros:
- amazon2023.0-large
- name: .jscore .common !jsCore !.feature_flag_guarded
- name: jsCore_txns_large_txns_format
- name: json_schema
- name: .jstestfuzz !.flow_control # Flow control jstestfuzz take longer.
- name: libunwind_tests
- name: .multi_shard
- name: multi_stmt_txn_jscore_passthrough_with_migration_gen
- name: .query_fuzzer !.feature_flag_guarded
- name: .read_write_concern .large
distros:
- amazon2023.0-large
- name: .read_write_concern !.large
- name: .replica_sets !.encrypt !.auth
distros:
- amazon2023.0-large
- name: replica_sets_api_version_jscore_passthrough_gen
- name: replica_sets_reconfig_jscore_passthrough_gen
- name: retryable_writes_jscore_passthrough_gen
- name: retryable_writes_jscore_stepdown_passthrough_gen
distros:
- amazon2023.0-large
- name: .read_only
- name: .rollbackfuzzer
- name: sasl
- name: search
- name: search_auth
- name: search_pinned_connections_auth
- name: search_ssl
- name: session_jscore_passthrough
- name: .sharding .jscore !.wo_snapshot !.multi_stmt
- name: sharding_api_version_jscore_passthrough_gen
- name: .sharding .txns
- name: .sharding .common !.multiversion
# TODO: SERVER-79886 Fix broken .crypt task
# - name: .crypt
# distros:
# - amazon2023.0-large
- name: secondary_reads_passthrough_gen
- name: server_discovery_and_monitoring_json_test_TG
- name: .serverless
distros:
- amazon2023.0-large
- name: server_selection_json_test_TG
distros:
- amazon2023.0-large
# TODO: SERVER-79886 Fix broken test_packages task
# - name: test_packages
# distros:
# - amazon2023.0-large
- name: generate_buildid_to_debug_symbols_mapping
- name: amazon2023-arm64
display_name: Amazon Linux 2023 arm64
@ -1051,129 +944,16 @@ buildvariants:
- name: .publish
- name: generate_buildid_to_debug_symbols_mapping
# This variant is a special variant to test LTO.
# We just want it to bake for a while before considering that we turn it on by default.
- name: enterprise-amazon2023-arm64-lto
display_name: "Enterprise Amazon Linux 2023 arm64 LTO"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
modules:
- enterprise
run_on:
- amazon2023.0-arm64-small
expansions:
additional_package_targets: archive-mongocryptd archive-mongocryptd-debug
compile_flags: >-
--ssl
MONGO_DISTMOD=amazon2023
-j$(grep -c ^processor /proc/cpuinfo)
--variables-files=etc/scons/mongodbtoolchain_stable_gcc.vars
--lto
--linker=gold
--link-model=object
crypt_task_compile_flags: SHLINKFLAGS_EXTRA="-Wl,-Bsymbolic -Wl,--no-gnu-unique" CCFLAGS="-fno-gnu-unique"
# TODO BUILD-13887 should fix uses_pykmip incompatibility.
test_flags: --excludeWithAnyTags=incompatible_with_amazon_linux,requires_ldap_pool,uses_pykmip,requires_v4_0,requires_external_data_source,requires_latch_analyzer
has_packages: true
multiversion_platform: amazon2023
multiversion_edition: enterprise
multiversion_architecture: aarch64
packager_script: packager_enterprise.py
packager_arch: aarch64
packager_distro: amazon2023
repo_edition: enterprise
scons_cache_scope: shared
compile_variant: enterprise-amazon2023-arm64-lto
large_distro_name: amazon2023.0-arm64-large
tasks:
- name: compile_test_and_package_serial_lto_no_unittests_TG
distros:
- amazon2023.0-arm64-large
- name: test_api_version_compatibility
- name: .aggfuzzer !.feature_flag_guarded !.multiversion
- name: .aggregation !.feature_flag_guarded
- name: audit
- name: .auth !.multiversion
- name: .causally_consistent !.sharding
- name: .change_streams
- name: .change_stream_fuzzer
- name: .misc_js
- name: .concurrency !.large !.no_txns
- name: .concurrency .large !.no_txns
distros:
- amazon2023.0-arm64-large
- name: .config_fuzzer !.large
- name: .config_fuzzer .large
distros:
- amazon2023.0-arm64-large
- name: disk_wiredtiger
- name: .encrypt
- name: idl_tests
- name: initial_sync_fuzzer_gen
- name: jsCore
distros:
- amazon2023.0-arm64-large
- name: .jscore .common !jsCore !.feature_flag_guarded
- name: jsCore_min_batch_repeat_queries_ese_gsm
- name: jsCore_txns_large_txns_format
- name: json_schema
- name: .jstestfuzz !.flow_control # Flow control jstestfuzz take longer.
- name: libunwind_tests
- name: .multi_shard
- name: multi_stmt_txn_jscore_passthrough_with_migration_gen
- name: .query_fuzzer !.feature_flag_guarded
- name: .read_write_concern .large
distros:
- amazon2023.0-arm64-large
- name: .read_write_concern !.large
- name: .replica_sets !.encrypt !.auth
distros:
- amazon2023.0-arm64-large
- name: replica_sets_api_version_jscore_passthrough_gen
- name: replica_sets_reconfig_jscore_passthrough_gen
- name: retryable_writes_jscore_passthrough_gen
- name: retryable_writes_jscore_stepdown_passthrough_gen
distros:
- amazon2023.0-arm64-large
- name: .read_only
- name: .rollbackfuzzer
- name: sasl
- name: search
- name: search_auth
- name: search_pinned_connections_auth
- name: search_ssl
- name: session_jscore_passthrough
- name: .sharding .jscore !.wo_snapshot !.multi_stmt
- name: sharding_api_version_jscore_passthrough_gen
- name: .sharding .txns
- name: .sharding .common !.multiversion
# TODO: SERVER-79886 Fix broken .crypt task
# - name: .crypt
# distros:
# - amazon2023.0-arm64-large
- name: secondary_reads_passthrough_gen
- name: server_discovery_and_monitoring_json_test_TG
- name: .serverless
distros:
- amazon2023.0-arm64-large
- name: server_selection_json_test_TG
distros:
- amazon2023.0-arm64-large
# TODO: SERVER-79886 Fix broken test_packages task
# - name: test_packages
# distros:
# - ubuntu2204-arm64-large
- name: generate_buildid_to_debug_symbols_mapping
- name: enterprise-amazon2-streams
display_name: "Amazon Linux 2 enterprise build with streams"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
modules:
- enterprise
run_on:
- amazon2-test
- amazon2-latest-small
expansions:
test_flags: >-
--excludeWithAnyTags=SERVER-34286,incompatible_with_amazon_linux,uses_pykmip,requires_external_data_source
--excludeWithAnyTags=SERVER-34286,incompatible_with_amazon_linux,uses_pykmip,requires_external_data_source,requires_latch_analyzer
push_path: linux
push_bucket: downloads.10gen.com
push_name: linux
@ -1196,7 +976,7 @@ buildvariants:
tasks:
- name: compile_test_and_package_serial_no_unittests_TG
distros:
- amazon2-build
- amazon2-latest-large
- name: .publish
- name: generate_buildid_to_debug_symbols_mapping
- name: streams

View File

@ -2,30 +2,6 @@
# rapid release (7.1, 7.2 etc.) and LTS release (7.0, 6.0 etc.) branch projects
buildvariants:
- name: enterprise-debian10-64
display_name: Jepsen Tests on Enterprise Debian 10
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
modules:
- enterprise
run_on:
- debian10-test
expansions:
compile_flags: >-
--ssl
MONGO_DISTMOD=debian10
-j$(grep -c ^processor /proc/cpuinfo)
--variables-files=etc/scons/mongodbtoolchain_stable_gcc.vars
scons_cache_scope: shared
large_distro_name: debian10-build
compile_variant: enterprise-debian10-64
tasks:
- name: compile_and_archive_dist_test_TG
distros:
- debian10-build
- name: .jepsen_docker
distros:
- debian10-large
- name: debian11
display_name: Debian 11
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
@ -74,7 +50,8 @@ buildvariants:
- name: .sharding .jscore !.wo_snapshot !.multi_stmt
- name: .sharding .common !.csrs !.encrypt
- name: sharding_max_mirroring_opportunistic_secondary_targeting_gen
- name: .ssl
# TODO SERVER-89541 Remove ocsp tag once oscrypto gets updated
- name: .ssl !.ocsp
- name: .stitch
- name: test_packages
distros:
@ -123,7 +100,8 @@ buildvariants:
- name: .aggfuzzer .common !.feature_flag_guarded
- name: audit
- name: causally_consistent_jscore_txns_passthrough
- name: .encrypt !.replica_sets !.aggregation !.sharding !.jscore
# TODO SERVER-89541 Remove ocsp tag once oscrypto gets updated
- name: .encrypt !.replica_sets !.aggregation !.sharding !.jscore !.ocsp
- name: .jscore .common !.decimal !.sharding !.feature_flag_guarded
- name: .jstestfuzz .common
- name: replica_sets_auth_gen
@ -186,7 +164,8 @@ buildvariants:
- name: .sharding .jscore !.wo_snapshot !.multi_stmt
- name: .sharding .common !.csrs !.encrypt !.multiversion
- name: sharding_max_mirroring_opportunistic_secondary_targeting_gen
- name: .ssl
# TODO SERVER-89541 Remove ocsp tag once oscrypto gets updated
- name: .ssl !.ocsp
- name: .stitch
- name: test_packages
distros:
@ -235,7 +214,8 @@ buildvariants:
- name: .aggfuzzer .common !.feature_flag_guarded !.multiversion
- name: audit
- name: causally_consistent_jscore_txns_passthrough
- name: .encrypt !.replica_sets !.aggregation !.sharding !.jscore
# TODO SERVER-89541 Remove ocsp tag once oscrypto gets updated
- name: .encrypt !.replica_sets !.aggregation !.sharding !.jscore !.ocsp
- name: .jscore .common !.decimal !.sharding !.feature_flag_guarded
- name: .jstestfuzz .common
- name: replica_sets_auth_gen

View File

@ -83,6 +83,9 @@ buildvariants:
- name: compile_test_serial_TG
distros:
- rhel81-power8-large
- name: compile_test_parallel_unittest_stream_TG
distros:
- rhel81-power8-large
- &enterprise-rhel-83-s390x-template
name: enterprise-rhel-83-s390x
@ -163,3 +166,6 @@ buildvariants:
- name: compile_test_serial_TG
distros:
- rhel83-zseries-large
- name: compile_test_parallel_unittest_stream_TG
distros:
- rhel83-zseries-large

View File

@ -67,17 +67,17 @@ buildvariants:
-j$(sysctl -n hw.logicalcpu)
--libc++
--variables-files=etc/scons/xcode_macosx_arm.vars
--use-diagnostic-latches=on
resmoke_jobs_max: 6
num_scons_link_jobs_available: 0.99
tasks:
- name: compile_test_serial_TG
- name: compile_test_parallel_unittest_stream_TG
- name: audit
- name: auth_audit_gen
- name: causally_consistent_jscore_txns_passthrough
- name: .encrypt !.replica_sets !.sharding !.aggregation !.jscore
- name: fle
- name: fle2
- name: .jscore .common !.decimal !.sharding
- name: replica_sets_auth_gen
- name: replica_sets_jscore_passthrough_gen
- name: sasl
- name: .crypt
- name: .timeseries_crud

View File

@ -23,36 +23,17 @@ buildvariants:
compile_variant: macos
tasks:
- name: compile_test_and_package_serial_TG
- name: compile_build_tools_next_TG
- name: .aggregation !.auth !.encrypt !.unwind !.feature_flag_guarded
- name: compile_test_parallel_unittest_stream_TG
- name: aggregation
- name: auth_gen
- name: .causally_consistent !.sharding
- name: .change_streams
- name: change_streams
- name: .misc_js
- name: .concurrency !.no_txns !.kill_terminate !.cursor_sweeps
- name: disk_wiredtiger
- name: initial_sync_fuzzer_gen
- name: .jscore .common !.auth !.feature_flag_guarded
- name: jsCore_txns_large_txns_format
- name: .jstestfuzz .causal
- name: .jstestfuzz .interrupt
- name: .jstestfuzz .common
- name: .jstestfuzz .session
- name: .query_fuzzer !.feature_flag_guarded
- name: .read_write_concern !.linearize
- name: .jscore .common !.auth !.sharding !.feature_flag_guarded
- name: replica_sets_gen
- name: replica_sets_kill_secondaries_jscore_passthrough
- name: replica_sets_max_mirroring_large_txns_format_gen
- name: .replica_sets .common !.auth
- name: retryable_writes_jscore_passthrough_gen
- name: .rollbackfuzzer
- name: session_jscore_passthrough
- name: .sharding .jscore !.wo_snapshot !.multi_stmt
- name: .sharding .txns
- name: .ssl
- name: .stitch
- name: push
- name: .timeseries_crud
- name: macos-arm64
display_name: macOS arm64
@ -75,36 +56,17 @@ buildvariants:
compile_variant: macos-arm64
tasks:
- name: compile_test_and_package_serial_TG
- name: compile_build_tools_next_TG
- name: .aggregation !.auth !.encrypt !.unwind !.feature_flag_guarded
- name: compile_test_parallel_unittest_stream_TG
- name: aggregation
- name: auth_gen
- name: .causally_consistent !.sharding
- name: .change_streams
- name: change_streams
- name: .misc_js
- name: .concurrency !.no_txns !.kill_terminate !.cursor_sweeps
- name: disk_wiredtiger
- name: initial_sync_fuzzer_gen
- name: .jscore .common !.auth !.feature_flag_guarded
- name: jsCore_txns_large_txns_format
- name: .jstestfuzz .causal
- name: .jstestfuzz .interrupt
- name: .jstestfuzz .common
- name: .jstestfuzz .session
- name: .query_fuzzer !.feature_flag_guarded
- name: .read_write_concern !.linearize
- name: .jscore .common !.auth !.sharding !.feature_flag_guarded
- name: replica_sets_gen
- name: replica_sets_kill_secondaries_jscore_passthrough
- name: replica_sets_max_mirroring_large_txns_format_gen
- name: .replica_sets .common !.auth
- name: retryable_writes_jscore_passthrough_gen
- name: .rollbackfuzzer
- name: session_jscore_passthrough
- name: .sharding .jscore !.wo_snapshot !.multi_stmt
- name: .sharding .txns
- name: .ssl
- name: .stitch
- name: push
- name: .timeseries_crud
- name: enterprise-macos
display_name: Enterprise macOS
@ -132,20 +94,16 @@ buildvariants:
compile_variant: enterprise-macos
tasks:
- name: compile_test_and_package_serial_TG
- name: compile_build_tools_next_TG
- name: compile_test_parallel_unittest_stream_TG
- name: audit
- name: auth_audit_gen
- name: causally_consistent_jscore_txns_passthrough
- name: .encrypt !.replica_sets !.sharding !.aggregation !.jscore
- name: .jscore .common !.decimal !.sharding !.feature_flag_guarded
- name: .jstestfuzz .common
- name: replica_sets_auth_gen
- name: replica_sets_jscore_passthrough_gen
- name: sasl
- name: push
- name: .crypt
- name: .publish_crypt
- name: .timeseries_crud
- name: enterprise-macos-arm64
display_name: Enterprise macOS arm64
@ -173,17 +131,13 @@ buildvariants:
compile_variant: enterprise-macos-arm64
tasks:
- name: compile_test_and_package_serial_TG
- name: compile_build_tools_next_TG
- name: compile_test_parallel_unittest_stream_TG
- name: audit
- name: auth_audit_gen
- name: causally_consistent_jscore_txns_passthrough
- name: .encrypt !.replica_sets !.sharding !.aggregation !.jscore
- name: .jscore .common !.decimal !.sharding !.feature_flag_guarded
- name: .jstestfuzz .common
- name: replica_sets_auth_gen
- name: replica_sets_jscore_passthrough_gen
- name: sasl
- name: push
- name: .crypt
- name: .publish_crypt
- name: .timeseries_crud

View File

@ -13,9 +13,7 @@ buildvariants:
burn_in_tag_include_all_required_and_suggested: true
burn_in_tag_exclude_build_variants: >-
macos-debug-suggested
burn_in_tag_include_build_variants: >-
enterprise-rhel-80-64-bit-inmem
enterprise-rhel-80-64-bit-multiversion
burn_in_tag_include_build_variants:
burn_in_tag_compile_task_dependency: archive_dist_test_debug
compile_variant: &amazon_linux2_arm64_dynamic_compile_variant_name amazon-linux2-arm64-dynamic-compile
depends_on:
@ -172,8 +170,8 @@ buildvariants:
distros:
- ubuntu1804-xlarge
- name: enterprise-rhel-80-64-bit-dynamic-ninja
display_name: "Ninja Build: Enterprise RHEL 8.0"
- name: enterprise-rhel-8-64-bit-dynamic-ninja
display_name: "Ninja Build: Enterprise RHEL 8"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
modules:
- enterprise

View File

@ -38,8 +38,8 @@ buildvariants:
tasks:
- name: build_metrics_gen_TG
- name: &enterprise-rhel-80-64-bit-build-metrics enterprise-rhel-80-64-bit-build-metrics
display_name: "~ Build Metrics Enterprise RHEL 8.0 "
- name: &enterprise-rhel-8-64-bit-build-metrics enterprise-rhel-8-64-bit-build-metrics
display_name: "~ Build Metrics Enterprise RHEL 8 "
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter
stepback: false
modules:
@ -58,7 +58,7 @@ buildvariants:
tasks:
- name: build_metrics_gen_TG
- name: &enterprise-rhel-80-aarch64-build-metrics enterprise-rhel-80-aarch64-build-metrics
- name: &enterprise-rhel-8-aarch64-build-metrics enterprise-rhel-8-aarch64-build-metrics
display_name: "~ Build Metrics Enterprise AL22 ARM"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter
stepback: false
@ -106,6 +106,7 @@ buildvariants:
- rhel80-small
expansions:
multiversion_platform: rhel80
multiversion_platform_50_or_later: rhel8
multiversion_edition: enterprise
compile_variant: *stm-daily-cron
stepback: false

View File

@ -1,4 +1,8 @@
# Build variant to generate tasks for evergreen versions.
#
# Updates to this file may also need to appear in etc/system_perf_yml_components/variants/task_generation.yml,
# which is the same but excludes resmoke task generation tasks.
#
buildvariants:
- name: generate-tasks-for-version

File diff suppressed because it is too large Load Diff

View File

@ -28,6 +28,7 @@ variables:
-j$(grep -c ^processor /proc/cpuinfo)
--variables-files=etc/scons/mongodbtoolchain_stable_gcc.vars
--link-model=dynamic
--use-diagnostic-latches=on
# THIS HAS COPIES IN:
# - etc/evergreen_yml_components/variants/rhel/test_dev_master_branch_only.yml
@ -53,6 +54,7 @@ variables:
# ANY MODIFICATIONS HERE SHOULD ALSO BE MADE IN THOSE FILES
- &linux_x86_generic_expansions
multiversion_platform: rhel80
multiversion_platform_50_or_later: rhel8
multiversion_edition: enterprise
repo_edition: enterprise
large_distro_name: rhel80-medium
@ -65,7 +67,7 @@ variables:
# - etc/evergreen_yml_components/variants/rhel/test_dev.yml
# - etc/evergreen_yml_components/variants/sanitizer/test_dev_master_branch_only.yml
# ANY MODIFICATIONS HERE SHOULD ALSO BE MADE IN THOSE FILES
- &enterprise-rhel-80-64-bit-dynamic-expansions
- &enterprise-rhel-8-64-bit-dynamic-expansions
<<: *linux_x86_generic_expansions
scons_cache_scope: shared
scons_cache_mode: all
@ -122,6 +124,7 @@ variables:
num_scons_link_jobs_available: 0.99
large_distro_name: rhel80-build
multiversion_platform: rhel80
multiversion_platform_50_or_later: rhel8
multiversion_edition: enterprise
gcov_tool: /opt/mongodbtoolchain/v4/bin/gcov
@ -148,17 +151,17 @@ buildvariants:
distros:
- rhel80-large
- &enterprise-rhel-80-64-bit-dynamic-template
- &enterprise-rhel-8-64-bit-dynamic-template
<<: *linux_x86_dynamic_compile_variant_dependency
name: &enterprise-rhel-80-64-bit-dynamic enterprise-rhel-80-64-bit-dynamic
display_name: "* Shared Library Enterprise RHEL 8.0"
name: &enterprise-rhel-8-64-bit-dynamic enterprise-rhel-8-64-bit-dynamic
display_name: "! Shared Library Enterprise RHEL 8"
cron: "0 */4 * * *" # From the ${project_required_suggested_cron} parameter
modules:
- enterprise
run_on:
- rhel80-small
expansions:
<<: *enterprise-rhel-80-64-bit-dynamic-expansions
<<: *enterprise-rhel-8-64-bit-dynamic-expansions
depends_on:
- name: archive_dist_test_debug
variant: *linux_x86_dynamic_compile_variant_name
@ -262,62 +265,63 @@ buildvariants:
- name: vector_search_auth
- name: vector_search_ssl
# TODO (SERVER-75884): Remove this variant once we switch to config shard as the default.
# This build variant is used to test suites that use sharded cluster fixture with config shard mode.
- &enterprise-rhel-80-64-bit-dynamic-config-shard
<<: *linux_x86_dynamic_compile_variant_dependency
name: enterprise-rhel-80-64-bit-dynamic-config-shard
display_name: "* Shared Library Enterprise RHEL 8.0 (Config Shard)"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
modules:
- enterprise
run_on:
- rhel80-small
stepback: false
expansions: &enterprise-rhel-80-64-bit-dynamic-config-shard-expansions
<<: *enterprise-rhel-80-64-bit-dynamic-expansions
test_flags: >-
--configShard=any
--excludeWithAnyTags=config_shard_incompatible
tasks:
- name: aggregation_mongos_passthrough
- name: aggregation_one_shard_sharded_collections
- name: aggregation_sharded_collections_causally_consistent_passthrough
- name: aggregation_sharded_collections_passthrough
- name: causally_consistent_hedged_reads_jscore_passthrough_gen
- name: causally_consistent_jscore_passthrough_auth_gen
- name: causally_consistent_jscore_passthrough_gen
- name: change_streams
- name: change_streams_mongos_sessions_passthrough
- name: change_streams_multi_stmt_txn_mongos_passthrough
- name: change_streams_multi_stmt_txn_sharded_collections_passthrough
- name: change_streams_per_shard_cursor_passthrough
- name: fle2_sharding_high_cardinality
- name: fle2_sharding
- name: jstestfuzz_sharded_causal_consistency_gen
- name: jstestfuzz_sharded_continuous_stepdown_gen
- name: jstestfuzz_sharded_gen
- name: jstestfuzz_sharded_session_gen
- name: sharded_causally_consistent_jscore_passthrough_gen
- name: sharded_causally_consistent_read_concern_snapshot_passthrough_gen
- name: sharding_auth_gen
# Explicitly include instead of using tags to avoid pulling in replica_sets_multiversion_gen. This
# variant will be removed when config shards become the default, so this is only temporary.
- name: sharding_multiversion_gen
- name: .sharding .txns
# Skip csrs stepdown suite because most tests can't handle the first shard stepping down.
- name: .sharding .common !.csrs
- name: .sharding .jscore !.wo_snapshot !.multi_stmt
- name: .concurrency .sharded !.large
- name: .concurrency .sharded .large
distros:
- rhel80-medium
- name: .multi_shard
# # TODO (SERVER-86211): Re-enable this variant once all the tests work.
# # TODO (SERVER-75884): Remove this variant once we switch to config shard as the default.
# # This build variant is used to test suites that use sharded cluster fixture with config shard mode.
# - &enterprise-rhel-8-64-bit-dynamic-config-shard
# <<: *linux_x86_dynamic_compile_variant_dependency
# name: enterprise-rhel-8-64-bit-dynamic-config-shard
# display_name: "* Shared Library Enterprise RHEL 8 (Config Shard)"
# cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
# modules:
# - enterprise
# run_on:
# - rhel80-small
# stepback: false
# expansions: &enterprise-rhel-8-64-bit-dynamic-config-shard-expansions
# <<: *enterprise-rhel-8-64-bit-dynamic-expansions
# test_flags: >-
# --configShard=any
# --excludeWithAnyTags=config_shard_incompatible
# tasks:
# - name: aggregation_mongos_passthrough
# - name: aggregation_one_shard_sharded_collections
# - name: aggregation_sharded_collections_causally_consistent_passthrough
# - name: aggregation_sharded_collections_passthrough
# - name: causally_consistent_hedged_reads_jscore_passthrough_gen
# - name: causally_consistent_jscore_passthrough_auth_gen
# - name: causally_consistent_jscore_passthrough_gen
# - name: change_streams
# - name: change_streams_mongos_sessions_passthrough
# - name: change_streams_multi_stmt_txn_mongos_passthrough
# - name: change_streams_multi_stmt_txn_sharded_collections_passthrough
# - name: change_streams_per_shard_cursor_passthrough
# - name: fle2_sharding_high_cardinality
# - name: fle2_sharding
# - name: jstestfuzz_sharded_causal_consistency_gen
# - name: jstestfuzz_sharded_continuous_stepdown_gen
# - name: jstestfuzz_sharded_gen
# - name: jstestfuzz_sharded_session_gen
# - name: sharded_causally_consistent_jscore_passthrough_gen
# - name: sharded_causally_consistent_read_concern_snapshot_passthrough_gen
# - name: sharding_auth_gen
# # Explicitly include instead of using tags to avoid pulling in replica_sets_multiversion_gen. This
# # variant will be removed when config shards become the default, so this is only temporary.
# - name: sharding_multiversion_gen
# - name: .sharding .txns
# # Skip csrs stepdown suite because most tests can't handle the first shard stepping down.
# - name: .sharding .common !.csrs
# - name: .sharding .jscore !.wo_snapshot !.multi_stmt
# - name: .concurrency .sharded !.large
# - name: .concurrency .sharded .large
# distros:
# - rhel80-medium
# - name: .multi_shard
- &enterprise-rhel-80-64-bit-dynamic-classic-engine
- &enterprise-rhel-8-64-bit-dynamic-classic-engine
<<: *linux_x86_dynamic_compile_variant_dependency
name: enterprise-rhel-80-64-bit-dynamic-classic-engine
display_name: "Shared Library Enterprise RHEL 8.0 (Classic Engine)"
name: enterprise-rhel-8-64-bit-dynamic-classic-engine
display_name: "Shared Library Enterprise RHEL 8 (Classic Engine)"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
modules:
- enterprise
@ -325,13 +329,14 @@ buildvariants:
- rhel80-small
stepback: false
expansions:
<<: *enterprise-rhel-80-64-bit-dynamic-expansions
<<: *enterprise-rhel-8-64-bit-dynamic-expansions
jstestfuzz_num_generated_files: 40
jstestfuzz_concurrent_num_files: 10
target_resmoke_time: 10
max_sub_suites: 5
test_flags: >-
--mongodSetParameters="{internalQueryFrameworkControl: forceClassicEngine}"
--excludeWithAnyTags=featureFlagSbeFull
large_distro_name: rhel80-medium
depends_on:
- name: archive_dist_test_debug
@ -442,8 +447,8 @@ buildvariants:
###########################################
- <<: *linux_debug_aubsan_compile_variant_dependency
name: &rhel80-debug-aubsan-classic-engine rhel80-debug-aubsan-classic-engine
display_name: "* {A,UB}SAN Enterprise RHEL 8.0 DEBUG (Classic Engine)"
name: &rhel8-debugaubsan-classic-engine rhel8-debugaubsan-classic-engine
display_name: "* {A,UB}SAN Enterprise RHEL 8 DEBUG (Classic Engine)"
cron: "0 4 * * *" # From the ${project_nightly_cron} parameter.
modules:
- enterprise
@ -453,7 +458,7 @@ buildvariants:
<<: *aubsan-lite-required-expansions
test_flags: >-
--mongodSetParameters="{internalQueryFrameworkControl: forceClassicEngine}"
--excludeWithAnyTags=requires_ocsp_stapling,requires_increased_memlock_limits
--excludeWithAnyTags=requires_ocsp_stapling,requires_increased_memlock_limits,featureFlagSbeFull
tasks:
- name: .aggregation !.sbe_only
- name: .auth
@ -488,7 +493,8 @@ buildvariants:
- name: sasl
- name: secondary_reads_passthrough_gen
- name: session_jscore_passthrough
- name: .sharding .jscore !.wo_snapshot
# TODO SERVER-85584 Reenable uninitialized_fcv passthrough
- name: .sharding .jscore !.wo_snapshot !.uninitialized_fcv
- name: .sharding .common !.csrs !.jstestfuzz
- name: .updatefuzzer
- name: .serverless

Some files were not shown because too many files have changed in this diff Show More