Skip to content

[RELEASE] Release version 3.0.0 #3747

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
63 of 66 tasks
opensearch-trigger-bot bot opened this issue Jul 16, 2023 · 54 comments
Closed
63 of 66 tasks

[RELEASE] Release version 3.0.0 #3747

opensearch-trigger-bot bot opened this issue Jul 16, 2023 · 54 comments
Assignees

Comments

@opensearch-trigger-bot
Copy link
Contributor

opensearch-trigger-bot bot commented Jul 16, 2023

Release Status: 3.0.0 (GA) Released now!

(3.0.0-alpha1 ensures early Integration - Ensure code compilation)

(You can still push feature to 3.0.0-beta1 if not ready by 3.0.0-alpha1)

(In GA only bugfixes can go into 3.0 branch, NOT feature as we already feature freeze in 3.0.0-beta1)

Release OpenSearch and OpenSearch Dashboards 3.0.0

I noticed that a manifest was automatically created in manifests/3.0.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria Status Description  Comments
Each component release issue has an assigned owner 🟢
Documentation draft PRs are up and in tech review for all component changes 🟢
Sanity testing is done for all components 🟢
Code coverage has not decreased (all new code has tests)
Release notes are ready and available for all components 🟢
Roadmap is up-to-date (information is available to create release highlights) 🟢
Release ticket is cut, and there's a forum post announcing the start of the window 🟢
Any necessary security reviews are complete

OpenSearch 3.0.0 exit criteria status:

Criteria Status Description  Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions 🟢
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days 🟢
Documentation has been fully reviewed and signed off by the documentation community. 🟢
All integration tests are passing 🟢
Release blog is ready 🟢

OpenSearch-Dashboards 3.0.0 exit criteria status:

Criteria Status Description  Comments
Documentation has been fully reviewed and signed off by the documentation community 🟢
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days 🟢
All integration tests are passing 🟢
Release blog is ready 🟢

Preparation

Campaigns

Version Increment - (2025/04/24-2025/04/28 3.0.0 GA)

Feature Freeze Code Freeze as feature is already freeze in 3.0.0-beta1

  • OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - (Ends 2025/04/28 3.0.0 GA)

Release Branch, Release Candidate Creation and Testing - (2025/04/28 3.0.0 GA)

Performance testing validation - (2025/04/30 3.0.0 GA)

  • Post the benchmark-tests
  • Longevity tests do not show any issues.

Pre Release - (2025/05/05 3.0.0 GA)

Release - (2025/05/06 3.0.0 GA)

Release Checklist.


Release Checklist

Pre-Release activities

  • Promote Repos.
      • OS
      • OSD
  • Promote Artifacts.
      • Windows
      • Linux Debian
      • Linux RPM
      • Linux TAR
  • Consolidated Release Notes.

Release activities

  • Docker Promotion.
  • Release Validation part 1.
      • OpenSearch and OpenSearch Dashboard Validation.
      • Validate the native plugin installation.
  • Merge consolidated release notes PR.
  • Website and Documentation Changes.
      • Merge staging website PR.
      • Promote the website changes to prod.
      • Add website alert.
  • Release Validation part 2.
      • Validate the artifact download URL's and signatures.
  • Release Validation part 3.
      • Trigger the validation build (Search for Completed validation for <> in the logs).
  • Maven Promotion.
  • Publish blog posts.
  • Advertise on Social Media.
  • Post on public slack and Github Release issue.


Post Release

Components

Replace with links to all component tracking issues.

Component On track Release Notes
{COMPONENT_ISSUE_LINK} {INDICATOR}} {STATUS}

OS:

OSD:

Issues:

Campaigns:

PRs:

Onboard GA:

Open Increment PR: https://github.com/pulls?q=is%3Apr+user%3Aopensearch-project+label%3Av3.0.0+%5BAUTO%5D+Increment+in%3Atitle+is%3Aopen+
Open PRs: https://github.com/pulls?q=is%3Aopen+is%3Apr+archived%3Afalse+user%3Aopensearch-project+label%3Av3.0.0
Open Issues: https://github.com/issues?q=is%3Aopen+is%3Aissue+archived%3Afalse+user%3Aopensearch-project+label%3Av3.0.0
Docs Pending: https://github.com/opensearch-project/documentation-website/issues?q=is%3Aissue+is%3Aopen+label%3Av3.0.0

Third Party Upgrades:

RFC/Discussion:


3.0.0-beta1 issues/PRs

Issues:

Campaigns:

PRs:

Onboard beta1:


3.0.0-alpha1 issues/PRs

Issues:

Campaigns:

Dreprecation:

PRs:

Version Bumps alpha1:
(OS)

(OSD)

Gradle 8.10.2 Bump:

GO/NOGO:

  • Update
@opensearch-trigger-bot opensearch-trigger-bot bot added release untriaged Issues that have not yet been triaged v3.0.0 labels Jul 16, 2023
This was referenced Jul 16, 2023
@peterzhuamazon
Copy link
Member

The 1st go/nogo meeting vote is a NO GO ❌:

We would need to resolve issues here: #3747 (comment)

Thanks.

@opensearch-ci-bot
Copy link
Collaborator

opensearch-ci-bot commented May 3, 2025

See OpenSearch RC 4 and OpenSearch-Dashboards RC 3 details

OpenSearch RC 4 and OpenSearch-Dashboards RC 3 details

## OpenSearch 11061 and OpenSearch-Dashboards 8430 is ready for your test.

OpenSearch - Build 11061
OpenSearch Dashboards - Build 8430

  • Use the following Docker-Compose to setup a cluster

    docker-compose.yml

      
    version: '3'
    services:
      opensearch-node1:
        image: opensearchstaging/opensearch:3.0.0.11061
        container_name: opensearch-node1
        environment:
          - cluster.name=opensearch-cluster
          - node.name=opensearch-node1
          - discovery.seed_hosts=opensearch-node1,opensearch-node2
          - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
          - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
          - OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
        ulimits:
          memlock:
            soft: -1
            hard: -1
          nofile:
            soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
            hard: 65536
        volumes:
          - opensearch-data1:/usr/share/opensearch/data
        ports:
          - 9200:9200
          - 9600:9600 # required for Performance Analyzer
        networks:
          - opensearch-net
      opensearch-node2:
        image: opensearchstaging/opensearch:3.0.0.11061
        container_name: opensearch-node2
        environment:
          - cluster.name=opensearch-cluster
          - node.name=opensearch-node2
          - discovery.seed_hosts=opensearch-node1,opensearch-node2
          - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
          - bootstrap.memory_lock=true
          - OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
        ulimits:
          memlock:
            soft: -1
            hard: -1
          nofile:
            soft: 65536
            hard: 65536
        volumes:
          - opensearch-data2:/usr/share/opensearch/data
        networks:
          - opensearch-net
      opensearch-dashboards:
        image: opensearchstaging/opensearch-dashboards:3.0.0.8430
        container_name: opensearch-dashboards
        ports:
          - 5601:5601
        expose:
          - "5601"
        environment:
          OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
        networks:
          - opensearch-net
    volumes:
      opensearch-data1:
      opensearch-data2:
    

    networks:
    opensearch-net:

    • Download the above docker-compose.yml on your machine.
    • Get latest image versions docker-compose pull.
    • Start the cluster docker-compose up.
  • OpenSearch docker 3.0.0.11061

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch:3.0.0.11061 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:3.0.0.11061
      • Connect command curl http://localhost:9200/
    • Start with security
      • Docker command
      docker pull opensearchstaging/opensearch:3.0.0.11061 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!" opensearchstaging/opensearch:3.0.0.11061
      
      • Connect command curl --insecure 'https://admin:myStrongPassword123!@localhost:9200/'
  • OpenSearch-Dashboards docker 3.0.0.8430

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch-dashboards:3.0.0.8430 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:3.0.0.8430
      • URL http://localhost:5601/
    • Start with security
      • Docker command docker pull opensearchstaging/opensearch-dashboards:3.0.0.8430 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:3.0.0.8430
      • URL http://localhost:5601/
  • Use TARs to deploy OpenSearch Manually

Check how to install opensearch and dashboards on different platforms

Integration Test Results

Thank you

OpenSearch Docker-Scan Results

Workflow run




opensearchstaging/opensearch:3.0.0 (amazon 2023.7.20250428 (Amazon Linux))
==========================================================================
Total: 0 (UNKNOWN: 0, LOW: 0, MEDIUM: 0, HIGH: 0, CRITICAL: 0)




OpenSearch-Dashboards Docker-Scan Results

Workflow run




opensearchstaging/opensearch-dashboards:3.0.0 (amazon 2023.7.20250428 (Amazon Linux))
=====================================================================================
Total: 0 (UNKNOWN: 0, LOW: 0, MEDIUM: 0, HIGH: 0, CRITICAL: 0)





IntegTest Results:

OS:

OSD: See RC3: #3747 (comment)

@peterzhuamazon
Copy link
Member

3.0.0 GA releasenotes:

@peterzhuamazon
Copy link
Member

peterzhuamazon commented May 4, 2025

@dblock
Copy link
Member

dblock commented May 4, 2025

The upgrade to beta 1 is showing test failures in API spec tests that worked before, likely a regression or two in OpenSearch, opensearch-project/opensearch-api-specification#879.

@peterzhuamazon
Copy link
Member

The upgrade to beta 1 is showing test failures in API spec tests that worked before, likely a regression or two in OpenSearch, opensearch-project/opensearch-api-specification#879.

Hi DB, is this because of breaking changes in core?

Thanks.

@peterzhuamazon
Copy link
Member

The upgrade to beta 1 is showing test failures in API spec tests that worked before, likely a regression or two in OpenSearch, opensearch-project/opensearch-api-specification#879.

Hi @dblock @expani @reta @getsaurabh02 could you take a look at this?

Thanks.

@peterzhuamazon
Copy link
Member

Reserve

1 similar comment
@peterzhuamazon
Copy link
Member

Reserve

@peterzhuamazon
Copy link
Member

Retrospect: #5174

@getsaurabh02
Copy link
Member

@dblock @peterzhuamazon All integration tests have passed across Beta and GA RCs, and no issues were reported during Alpha or Beta. A server-side regression seems unlikely, this might be due to a spec change which needs to be fixed in tests?

@getsaurabh02
Copy link
Member

getsaurabh02 commented May 4, 2025

@dblock @peterzhuamazon @andrross I took a quick look and seems like some of the failures are coming from ndices/search_shards.yaml and indices/settings.yaml which needs to updated based on the searchOnly property is not defined in the spec.

This is a new addition with Reader/Writer Separation feature added in 3.0 and needs a spec update. Tagging @mch2 @prudhvigodithi who worked on the feature to help update the spec.


FAILED  RESPONSE PAYLOAD SCHEMA (data/shards/0/0/searchOnly property is not defined in the spec)
FAILED  RESPONSE PAYLOAD SCHEMA (data/shards/0/0/searchOnly property is not defined in the spec)
FAILED  RESPONSE PAYLOAD SCHEMA (data/movies/defaults/index/blocks/search_only property is not defined in the spec,

@prudhvigodithi
Copy link
Member

This is a new addition with Reader/Writer Separation feature added in 3.0 and needs a spec update. Tagging @mch2 @prudhvigodithi who worked on the feature to help update the spec.

Let me take a look and update the spec to fix the error.

@prudhvigodithi
Copy link
Member

prudhvigodithi commented May 5, 2025

I have created a PR opensearch-project/opensearch-api-specification#883 for 3.0.0 API spec compatibility which was broken after beta release.
@dblock @peterzhuamazon @getsaurabh02

@peterzhuamazon
Copy link
Member

Hi All,

The 2nd go/nogo meeting result is a GO ✅ !
We are clear on all the blockers.
And will schedule the release on
Tomorrow Tuesday 2025/05/06 2PM PST time as planned.

Thanks!

@zelinh
Copy link
Member

zelinh commented May 5, 2025

Native plugin installation is validated.

~/workspace/distribution/opensearch-3.0.0 ./bin/opensearch-plugin install repository-s3
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.io.FilePermission config#plus read
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.RuntimePermission setContextClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission aws.configFile read,write
* java.util.PropertyPermission aws.sharedCredentialsFile read,write
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
* java.util.PropertyPermission opensearch.path.conf read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

@peterzhuamazon
Copy link
Member

RPM:

# env OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123! yum install opensearch opensearch-dashboards
Last metadata expiration check: 0:01:30 ago on Mon May  5 21:55:15 2025.
Dependencies resolved.
============================================================================================================================================================================================================================================================================================================================
 Package                                                                            Architecture                                                        Version                                                                Repository                                                                              Size
============================================================================================================================================================================================================================================================================================================================
Installing:
 opensearch                                                                         x86_64                                                              3.0.0-1                                                                opensearch-3.x                                                                         881 M
 opensearch-dashboards                                                              x86_64                                                              3.0.0-1                                                                opensearch-dashboards-3.x                                                              293 M

Transaction Summary
============================================================================================================================================================================================================================================================================================================================
Install  2 Packages

Total download size: 1.1 G
Installed size: 2.5 G
Is this ok [y/N]: y
Downloading Packages:
(1/2): opensearch-dashboards-3.0.0-linux-x64.rpm                                                                                                                                                                                                                                             27 MB/s | 293 MB     00:10
(2/2): opensearch-3.0.0-linux-x64.rpm                                                                                                                                                                                                                                                        37 MB/s | 881 MB     00:23
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                                                                                                                                                        49 MB/s | 1.1 GB     00:23
OpenSearch 3.x                                                                                                                                                                                                                                                                              101 kB/s | 3.8 kB     00:00
Importing GPG key 0x81191457:
 Userid     : "OpenSearch Project <[email protected]>"
 Fingerprint: A8B2 D9E0 4CD5 1FEF 6AA2 DB53 BA81 D999 8119 1457
 From       : https://artifacts.opensearch.org/publickeys/opensearch-release.pgp
Is this ok [y/N]: y
Key imported successfully
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                                                                                                                                                                                                                    1/1
  Running scriptlet: opensearch-dashboards-3.0.0-1.x86_64                                                                                                                                                                                                                                                               1/2
  Installing       : opensearch-dashboards-3.0.0-1.x86_64

@peterzhuamazon
Copy link
Member

DEB

# env OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123! apt install opensearch opensearch-dashboards
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
  opensearch opensearch-dashboards
0 upgraded, 2 newly installed, 0 to remove and 4 not upgraded.
Need to get 1352 MB of archives.
After this operation, 2729 MB of additional disk space will be used.
Get:1 https://artifacts.opensearch.org/releases/bundle/opensearch/3.x/apt stable/main amd64 opensearch amd64 3.0.0 [975 MB]
Get:2 https://artifacts.opensearch.org/releases/bundle/opensearch-dashboards/3.x/apt stable/main amd64 opensearch-dashboards amd64 3.0.0 [377 MB]
Fetched 1269 MB in 42s (30.4 MB/s)
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package opensearch.
(Reading database ... 66337 files and directories currently installed.)
Preparing to unpack .../opensearch_3.0.0_amd64.deb ...
Running OpenSearch Pre-Installation Script
Unpacking opensearch (3.0.0) ...
Selecting previously unselected package opensearch-dashboards.
Preparing to unpack .../opensearch-dashboards_3.0.0_amd64.deb ...
Running OpenSearch-Dashboards Pre-Installation Script
Unpacking opensearch-dashboards (3.0.0) ...
Setting up opensearch (3.0.0) ...
Running OpenSearch Post-Installation Script
### NOT starting on installation, please execute the following statements to configure opensearch service to start automatically using systemd
 sudo systemctl daemon-reload
 sudo systemctl enable opensearch.service
### You can start opensearch service by executing
 sudo systemctl start opensearch.service
### Create opensearch demo certificates in /etc/opensearch/
 See demo certs creation log in /var/log/opensearch/install_demo_configuration.log
### Breaking change in packaging since 2.13.0
 In 2.13.0 and later releases of OpenSearch, we have changed the permissions associated with access to installed files
 If you are configuring tools that require read access to the OpenSearch configuration files, we recommend you add the user that runs these tools to the 'opensearch' group
 For more information, see https://github.com/opensearch-project/opensearch-build/pull/4043
Setting up opensearch-dashboards (3.0.0) ...
Running OpenSearch-Dashboards Post-Installation Script
### NOT starting on installation, please execute the following statements to configure opensearch-dashboards service to start automatically using systemd
 sudo systemctl daemon-reload
 sudo systemctl enable opensearch-dashboards.service
### You can start opensearch-dashboards service by executing
 sudo systemctl start opensearch-dashboards.service
### Breaking change in packaging since 2.13.0
 In 2.13.0 and later releases of OpenSearch Dashboards, we have changed the permissions associated with access to installed files
 If you are configuring tools that require read access to the OpenSearch Dashboards configuration files, we recommend you add the user that runs these tools to the 'opensearch-dashboards' group
 For more information, see https://github.com/opensearch-project/opensearch-build/pull/4043

@peterzhuamazon
Copy link
Member

Release commit lock: #5512

@peterzhuamazon
Copy link
Member

peterzhuamazon commented May 6, 2025

Hi All,

We have just release 3.0.0 (GA) to the public! 🎉

Component Owners:

  • Please bump main to 3.1.0 if not done already
  • Please cut release in your repo based on 3.0.0 or 3.0.0.0 tags that we already cut in your repo
  • Please write / update any related items to Retrospect 3.0.0 issue here: [Retrospective] Release Version 3.0.0 #5174

Thanks to all that help make this release happen.
It is truly a great effort from everyone to get the release going and launch today. 😄

Thanks!

@peterzhuamazon
Copy link
Member

Close this issue as version 3.0.0 has been released to the public now.

Thanks.

@github-project-automation github-project-automation bot moved this from 🏗 In progress to ✅ Done in Engineering Effectiveness Board May 7, 2025
@gaiksaya gaiksaya unpinned this issue May 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: ✅ Done
Development

No branches or pull requests

10 participants