birkeh/o3de
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,122 Commits 3 Branches 3 Tags
development
Commit Graph

105 Commits

Author SHA1 Message Date
brianherrera 991f97a666 Add overall timeout for the AR pipeline 
Signed-off-by: brianherrera <briher@amazon.com>
 2022-01-28 14:06:45 -08:00
Mike Chang 5ebe3d12df Add file exists conditional for ebs_snapshot stash command (#7178) 
Signed-off-by: Mike Chang <changml@amazon.com>
 2022-01-26 17:11:58 -08:00
Mike Chang 6eec5e1a21 EBS snapshot script (#6978) 
Adding snapshot script, modify Jenkinsfile and build_config.json for each platform to use the snapshot tag

Signed-off-by: Mike Chang <changml@amazon.com>
 2022-01-26 13:00:46 -08:00
Shirang Jia 858a92f394 Deduplicate Jenkins parameters (#7035) 
Signed-off-by: Shirang Jia <shiranj@amazon.com>
 2022-01-20 15:47:53 -08:00
Mike Chang 6a171d1769 Windows installer build tag date fix (#6735) 
Makes the % string replacement optional in the palSh function

Signed-off-by: Mike Chang <changml@amazon.com>
 2022-01-06 16:41:35 -08:00
Shirang Jia 1d0cd46cb7 Escape % for windows batch in palSh (#6688) 
Signed-off-by: Shirang Jia <shiranj@amazon.com>
 2022-01-05 09:54:52 -08:00
evanchia 0f2e33af68 Changed test artifact upload check 
Signed-off-by: evanchia <evanchia@amazon.com>
 2022-01-03 16:48:20 -08:00
Shirang Jia cc242b2239 Fix pipeline name passed to post ar build sns (#6305) 
Signed-off-by: Shirang Jia <shiranj@amazon.com>
 2021-12-09 18:16:19 -08:00
Sean Sweeney c6e06a64ca Merge pull request #6264 from aws-lumberyard-dev/upload_test_artifacts 
Modified Jenkinsfile to upload test artifacts on failure
 2021-12-09 15:23:13 -08:00
evanchia 2db4927f73 added clarifying comment 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-12-09 14:05:30 -08:00
evanchia 117939f605 fixed env var check 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-12-09 11:24:18 -08:00
evanchia 73ca596c35 added env var check for test artifact upload 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-12-09 09:48:24 -08:00
evanchia 4d3a6169cb removing the jobname from test artifact upload directory 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-12-09 09:42:33 -08:00
Shirang Jia 6e6845dbf3 Pass pipeline name to post ar build sns topic (#6274) 
Signed-off-by: Shirang Jia <shiranj@amazon.com>
 2021-12-08 18:52:28 -08:00
evanchia 4992bce4c2 Modified Jenkinsfile to upload test artifacts on failure 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-12-08 14:09:48 -08:00
Esteban Papp 1a46f548a7 Remove unused scripts/build/package (#5885) 
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
 2021-12-01 09:14:07 -08:00
Shirang Jia ebd679d8cf Don't fail the build when AP logs upload fails (#5849) 
* Fix retry of failures from catch block

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Make the build unstable when AP load fails

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Remove test codes

Signed-off-by: Shirang Jia <shiranj@amazon.com>
 2021-11-22 17:46:49 -08:00
Shirang Jia c0080d6b1f Archive ap logs on s3 (#5620) 
* Archive ap logs on s3

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Update copy_file.py

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Fix syntax from bad copy

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Change underscore in argument name to dash

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Add a general ArchiveArtifactsOnS3 function so we can use it to archive any files on S3

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Swap order of excludes and includes

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Change artifactsSourceDir to artifactsSource since the value can be either a file or a directory

Signed-off-by: Shirang Jia <shiranj@amazon.com>

* Fix parameter

Signed-off-by: Shirang Jia <shiranj@amazon.com>
 2021-11-19 10:45:09 -08:00
brianherrera 92f1883cae Remove timeout in the mount step 
We no longer need a timeout here. A timeout mechanism was added to the mount script to raise an exeception if the EBS volume is not mounted in the configured timeframe.

This also causes a bug with the retry mechanism where Jenkins will hit this timeout in the event the node goes offline during the setup stage instead of raising an exception.

Signed-off-by: brianherrera <briher@amazon.com>
 2021-11-09 11:50:01 -08:00
Esteban Papp eecf6ab920 Create a nightly job that validates project-centric/engine-prebuilt (#5287) 
* adds a test_install_profile_vs2019_pipe job to validate a project can build from the SDK

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* missed escaping these variables and breaks runtime dependencines in the install layout

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* Changes to PIPELINE_ENV_OVERRIDE

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* Tries to propagate ENV variables from pipeline jobs to jobs under it

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* Fixes typo

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* echoing a var to understand why is not going to the right path

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* put the COMMAND_CWD in the wrong job

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* adding similar jobs for linux/mac

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* dont pass an empty LY_PROJECTS

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* cmd -> sh, copy-paste mistake

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* inverting check in linux/mac

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* more fixes for linux/mac

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* fixing script paths for macos

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* more fixes for linux/mac

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* Test use of %% instead of !! for windows builds

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* fixes typo

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
 2021-11-05 12:30:19 -07:00
Shirang Jia 08115fc41f Add platform name to AP log path on S3 (#5316) 
* Add platform name to AP log path on S3

Signed-off-by: shiranj <shiranj@amazon.com>

* Add platform name to AP log path on S3

Signed-off-by: shiranj <shiranj@amazon.com>
 2021-11-05 10:36:14 -07:00
Shirang Jia d584732116 Fix ap log path on s3 (#5257) 
* Fix typo when calling upload_to_s3.py

Signed-off-by: shiranj <shiranj@amazon.com>

* Remove space in extra_args

Signed-off-by: shiranj <shiranj@amazon.com>
 2021-11-03 10:45:12 -07:00
Brian Herrera fa83a1fff8 Merge pull request #5146 from aws-lumberyard-dev/devops/update-snapshots 
Update snapshots list to stablization/2110
 2021-11-01 09:59:51 -07:00
Shirang Jia 1ec34f6123 Fix typo when calling upload_to_s3.py (#5139) 
Signed-off-by: shiranj <shiranj@amazon.com>
 2021-10-29 21:11:53 -07:00
Mike Chang 22820b6a90 Update snapshots list to stablization/2110 
Signed-off-by: Mike Chang <changml@amazon.com>
 2021-10-29 15:13:20 -07:00
Shirang Jia b8ced0d461 Fix AP log path on S3 (#5068) 
Signed-off-by: shiranj <shiranj@amazon.com>
 2021-10-28 13:31:33 -07:00
Shirang Jia 7ab0871327 Upload AP logs when there is an AP eeror (#4896) 
* Updating LFS config to new endpoint (#1624)

Signed-off-by: AMZN-alexpete

* Updates licenses to APACHE-2.0 OR MIT (#1685)

Not to be committed before 7/6/2021

Signed-off-by: lawsonamzn <70027408+lawsonamzn@users.noreply.github.com>

* Updating CONTRIBUTING.md

Signed-off-by: Terry Michaels <miterenc@amazon.com>

* Fixed typo

Signed-off-by: Terry Michaels <miterenc@amazon.com>

* Updated text to be more descriptive

Signed-off-by: Terry Michaels <miterenc@amazon.com>

* Upload AP logs when there is an AP eeror

Signed-off-by: shiranj <shiranj@amazon.com>

* Add AP log upload step for single step Asset jobs

Signed-off-by: shiranj <shiranj@amazon.com>

* Address more comments

Signed-off-by: shiranj <shiranj@amazon.com>

* Only call CreateUploadAPLogsStage() once in try/catch block

Signed-off-by: shiranj <shiranj@amazon.com>

* Revert acciental update to README.md

Signed-off-by: shiranj <shiranj@amazon.com>

Co-authored-by: Alex Peterson <26804013+AMZN-alexpete@users.noreply.github.com>
Co-authored-by: Chris Galvan <chgalvan@amazon.com>
Co-authored-by: Nicholas Lawson <70027408+lawsonamzn@users.noreply.github.com>
Co-authored-by: Terry Michaels <miterenc@amazon.com>
 2021-10-25 19:16:29 -07:00
Mike Chang 8ab1cfacf5 Fixes for Test Screenshot upload build step (#4792) 
Fixes the test screenshot upload build step:

- Added missing positional parameters
- Double quoting the command statements to allow variable expansion (also fixes broken Python call)
- Escaping the double quotes within the command statement

Signed-off-by: Mike Chang <changml@amazon.com>
 2021-10-19 14:06:03 -07:00
Shirang Jia 8f1a589fcf Send message to post_ar_build SNS topic after build finished (#4442) 
* Send message to post_ar_build SNS topic after build finished

Signed-off-by: shiranj <shiranj@amazon.com>

* Add build number to SNS message

Signed-off-by: shiranj <shiranj@amazon.com>
 2021-10-06 09:27:20 -07:00
brianherrera eaddd4eee7 Throw exception for build stage 
This is required so Jenkins will properly mark the build failed on valid script errors.

Signed-off-by: brianherrera <briher@amazon.com>
 2021-09-21 16:05:25 -07:00
brianherrera d44cc844d1 Retry pipeline stages when a node goes offline 
This change is required to support spot instances in the AR pipeline.

- When a node goes offline the job is retried on a new node
- Valid script errors are handled properly and the status is updated in Jenkins

Signed-off-by: brianherrera <briher@amazon.com>
 2021-09-21 15:06:31 -07:00
jromnoa 5c4ce8cd06 Upload test screenshots to s3 on test failure. (#3815) 
* add s3 upload on screenshot test failure, should only apply to the test_gpu_profile_vs2019 job on nightly runs

* adds support for zipping screenshot files up prior to uploading to the s3 bucket and also adds the ACL extra arg to the upload_to_s3.py execution

* remove unused json import

* remove regex to use .endswith() instead and rename variables to be more clear (PR feedback)

* rename create_zip_archive to create_screenshots_archive

Signed-off-by: jromnoa <jromnoa@amazon.com>
 2021-09-08 06:11:44 -05:00
Shirang Jia c1c6fa3615 Auto-cut Github issue on build failures from main/development (#3730) 
* Send SNS topic on build failure

* send build failure root cause data to SNS topic that triggeres lambda function to automatically create Github issues

* Change SNS topic subject to Build failure and add build url to the message

* Change SNS topic name
 2021-08-31 17:37:25 -07:00
Sean Sweeney 873654a9fc Merge pull request #3116 from aws-lumberyard-dev/benchmark_metrics_jenkins 
Adds the MARS benchmark script in AR
 2021-08-31 15:58:20 -07:00
evanchia 5e4ec8c421 adding missing param to Jenkins benchmark step 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-08-27 10:14:22 -07:00
Shirang Jia ce85bb3b7d Add awsi deployment as a non-blocking step in nightly pipeline (#3397) 
* Add awsi deployment as a non-blocking step in nightly pipeline

* Make step fail if it's not a non-blocking step
 2021-08-24 10:43:17 -07:00
Mike Chang a92684c0b8 Jenkinsfile LFS fix for iOS/Mac pulls (#3396) 
* Add git lfs install and pull into Jenkins Git pull stage

Signed-off-by: Mike Chang <changml@amazon.com>
 2021-08-23 16:07:02 -07:00
John dcde3f3e36 Add extra logging for CHANGE_ID and COMMIT_ID. 
Signed-off-by: John <jonawals@amazon.com>
 2021-08-19 18:18:45 +01:00
Shirang Jia e48798fdbf Add missing {} for string interpolation (#3291) 2021-08-18 10:02:24 -07:00
Shirang Jia 3e51240a05 Allow customized Jenkins parameters for different pipelines and add aws integration deployment pipeline (#3248) 
Allow customized Jenkins parameters for different pipelines so that we can define different Jenkins parameters for a new pipeline and doesn't affect AR build parameters.

Add aws integration deployment pipeline.
 2021-08-17 15:25:32 -07:00
evanchia 78d34e6960 Adds the MARS benchmark script in AR 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-08-13 14:10:43 -07:00
Sean Sweeney 54b93d7c25 Merge pull request #2885 from aws-lumberyard-dev/test_metrics_env_var_fix 
Escape character in Jenkins for test metrics
 2021-08-09 14:03:02 -07:00
Shirang Jia 4f9382e8c6 Include build failure root cause in email notification (#2491) (#2888) 
Signed-off-by: shiranj <shiranj@amazon.com>
 2021-08-06 12:52:04 -07:00
evanchia 3a76f2e6ce Fixing incorrect string replacement in Jenkinsfile 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-08-05 17:41:06 -07:00
evanchia 574bef0cd8 Escape character in Jenkins for test metrics 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-08-05 10:19:15 -07:00
amzn-sean 3ade098742 support node switching in a pipe (#2345) 
Signed-off-by: amzn-sean <75276488+amzn-sean@users.noreply.github.com>
 2021-07-26 11:16:13 +01:00
Steve Pham 38261d0800 Shorten copyright headers by splitting into 2 lines (#2213) 
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines

Signed-off-by: Steve Pham <spham@amazon.com>
 2021-07-16 15:25:48 -07:00
brianherrera 1121bf6e60 Remove separate git lfs steps. 
The steps to remove git lfs hooks and inject creds are no longer required with the public repo.

Signed-off-by: brianherrera <briher@amazon.com>
 2021-07-12 09:14:16 -07:00
Chris Galvan 3b1873b045 Merged stabilization/2106 -> development (resolved merge conflicts). 
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
 2021-07-08 13:56:47 -05:00
Shirang Jia 992f5aab1b Convert Incremental scripts to Python3 (#1934) 
Convert incremental build script to Python3
 2021-07-07 15:12:10 -07:00