Commit Graph

447 Commits

Author SHA1 Message Date
Junbo Liang c759bc9cd0 Update the Jenkins script to disable access log during AWSI deployment (#4579)
Signed-off-by: Junbo Liang <junbo@amazon.com>
2021-10-11 10:52:00 -07:00
Brian Herrera 0d576004fe Merge pull request #4577 from aws-lumberyard-dev/pipelines/add-retry-inc-build-util
Add retry config to boto3 clients
2021-10-08 14:27:43 -07:00
Junbo Liang a5cd1b55e4 Make the access log bucket optional in the AWSCore CDK application (#4553)
* Make the access log bucket optional in the AWSCore CDK application

Signed-off-by: Junbo Liang <junbo@amazon.com>
2021-10-08 10:37:50 -07:00
brianherrera e256df3f05 Add retry config to boto3 clients
This change makes the inc_build_util script more resilient against transient network issues and issues encountered during node boot-up.

Signed-off-by: brianherrera <briher@amazon.com>
2021-10-08 10:05:50 -07:00
Chris Galvan 437a4d2d63 Updated engine template unit tests.
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
2021-10-07 17:38:54 -05:00
Chris Galvan e1c02cc146 Updated cpp file extension check per PR feedback.
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
2021-10-07 15:32:57 -05:00
Chris Galvan a138094027 Updated create-template logic to prefer the SanitizedCppName when running replacements on cpp file contents.
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
2021-10-07 14:34:29 -05:00
AMZN-Phil 8d5d5f8bfb Merge pull request #4505 from aws-lumberyard-dev/CLIAddExternalGemRepo
Fix issues with adding a repo
2021-10-06 14:10:52 -07:00
jonawals ae96d1ab86 Merge pull request #4525 from aws-lumberyard-dev/tiaf_disable
Disable TIAF Jenkins job
2021-10-06 20:58:56 +01:00
Shirang Jia 8f1a589fcf Send message to post_ar_build SNS topic after build finished (#4442)
* Send message to post_ar_build SNS topic after build finished

Signed-off-by: shiranj <shiranj@amazon.com>

* Add build number to SNS message

Signed-off-by: shiranj <shiranj@amazon.com>
2021-10-06 09:27:20 -07:00
John 79bd15aabd Disable TIAF job
Signed-off-by: John <jonawals@amazon.com>
2021-10-06 15:45:51 +01:00
AMZN-Phil 64fa92c56d Constrain exceptions to the type we are handling.
Signed-off-by: AMZN-Phil <pconroy@amazon.com>
2021-10-05 14:41:20 -07:00
AMZN-Phil 09342694c9 Fix issues with adding a repo and make each object type optional in repo.json
Signed-off-by: AMZN-Phil <pconroy@amazon.com>
2021-10-05 13:49:27 -07:00
Esteban Papp f3e6adce7f LYN-6882 release builds are executing code in asserts (#4305)
* adding Windows/release to PR-validation builds

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* changing trace back to expand to nothing for release

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* typo

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* more fixes

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* fixing some more unused variable cases

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* renaming file in ScriptCanvas that causes a msbuild warning

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>

* reverting a previous change

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
2021-10-01 13:52:52 -07:00
Mike Chang 0b718d435c Installer, bootstrapper, and executable signing for Windows (#4406)
* Added a codesigning script to pre and post build steps in the Windows installer CD job

* Changed `windows_installer` job name to `installer_vs2019`

* Added `installer-nightly` tag for `installer_vs2019`

* Updated `build_config.json` to use an envvar for the installer url and bucket

Signed-off-by: Mike Chang <changml@amazon.com>
2021-09-30 17:40:34 -07:00
dialweb6 4627361b4e Merge pull request #4245 from AMZN-scspaldi/scspaldi_update_Jenkins_test_results
Updated Linux and Mac configs to show test results.
2021-09-28 09:36:09 -07:00
Brian Herrera aaf292f8cd Merge pull request #4250 from aws-lumberyard-dev/pipelines/retry-pipeline
Retry pipeline stages when a node goes offline
2021-09-22 09:11:16 -07:00
brianherrera eaddd4eee7 Throw exception for build stage
This is required so Jenkins will properly mark the build failed on valid script errors.

Signed-off-by: brianherrera <briher@amazon.com>
2021-09-21 16:05:25 -07:00
Mike Chang 39a4e05492 Change installer domain to o3debinaries.org (#4244)
* Change installer domain to o3debinaries.org

* Removed 3p license parameter

Signed-off-by: Mike Chang <changml@amazon.com>
2021-09-21 15:24:14 -07:00
brianherrera d44cc844d1 Retry pipeline stages when a node goes offline
This change is required to support spot instances in the AR pipeline.

- When a node goes offline the job is retried on a new node
- Valid script errors are handled properly and the status is updated in Jenkins

Signed-off-by: brianherrera <briher@amazon.com>
2021-09-21 15:06:31 -07:00
scspaldi d11dbd3732 Updated Linux and Mac configs to show test results.
Signed-off-by: scspaldi <scspaldi@amazon.com>
2021-09-21 11:50:04 -07:00
Chris Burel 3812e60ab6 Add support for keyboard events from xcb (#3971)
Signed-off-by: Chris Burel <burelc@amazon.com>
2021-09-20 09:09:50 -07:00
brianherrera 0d0b6c8033 Add support for nvme volumes
Signed-off-by: brianherrera <briher@amazon.com>
2021-09-13 17:04:47 -07:00
Junbo Liang 3535d6b6b3 [AWS Automation] Stack tear down mechanism for the deployment on Jenkins (#3656)
Make awsi_test_profile_vs2019 a nonblocking step to make sure that resources are cleaned up even though automation tests failed

Signed-off-by: Junbo Liang <junbo@amazon.com>
2021-09-10 12:56:41 -07:00
jromnoa 5c4ce8cd06 Upload test screenshots to s3 on test failure. (#3815)
* add s3 upload on screenshot test failure, should only apply to the test_gpu_profile_vs2019 job on nightly runs

* adds support for zipping screenshot files up prior to uploading to the s3 bucket and also adds the ACL extra arg to the upload_to_s3.py execution

* remove unused json import

* remove regex to use .endswith() instead and rename variables to be more clear (PR feedback)

* rename create_zip_archive to create_screenshots_archive

Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-09-08 06:11:44 -05:00
Junbo Liang 8edcc504bd Add AWSI automation tests to a new test suite and pipe (#3913)
Signed-off-by: junbo <junbo@amazon.com>
2021-09-07 13:02:13 -07:00
bosnichd 82659f24e9 Add support for a custom path root separator using a trait. (#3678)
* - Add support for a custom path root separator using a trait.
- Ensure to set both FilePathKey_ProjectUserPath and FilePathKey_ProjectLogPath to a writeable storage location on non-host platforms.

Signed-off-by: bosnichd <bosnichd@amazon.com>

* Remove az_trait_validator.py, as our PAL guidance no longer dictates that all traits must be defined for all platforms.

Signed-off-by: bosnichd <bosnichd@amazon.com>

* Updated based on review feedback.

Signed-off-by: bosnichd <bosnichd@amazon.com>
2021-09-01 10:24:29 -06:00
Shirang Jia c1c6fa3615 Auto-cut Github issue on build failures from main/development (#3730)
* Send SNS topic on build failure

* send build failure root cause data to SNS topic that triggeres lambda function to automatically create Github issues

* Change SNS topic subject to Build failure and add build url to the message

* Change SNS topic name
2021-08-31 17:37:25 -07:00
Sean Sweeney 873654a9fc Merge pull request #3116 from aws-lumberyard-dev/benchmark_metrics_jenkins
Adds the MARS benchmark script in AR
2021-08-31 15:58:20 -07:00
Mike Chang 2bf83ad9fb Ubuntu 20.04 package update for clang-12 (#3727)
* Updated CMake, added libxkbcommon-dev and clang-12

* Add Corretto JDK 11 to packages for Ubuntu 20 and 18

* Add mountpoint creation command

Signed-off-by: Mike Chang <changml@amazon.com>
2021-08-31 13:47:57 -07:00
Mike Chang 6e3b03dfaa Install and configure Ubuntu nodes with Nvidia drivers and NiceDCV (#3728)
These scripts will configure build and test Ubuntu 18/20 nodes with:

Nvidia gaming drivers for GPU instances (g4dn)
lightdm for Ubuntu 18 and gdm3 for Ubuntu 20 (wayland is disabled here, but should have xcb capabilities)
NiceDCV for remote console access

Note: Does not include user setup and firewall configurations

Signed-off-by: Mike Chang <changml@amazon.com>
2021-08-31 09:47:57 -07:00
evanchia 5e4ec8c421 adding missing param to Jenkins benchmark step
Signed-off-by: evanchia <evanchia@amazon.com>
2021-08-27 10:14:22 -07:00
lumberyard-employee-dm b53182fdb6 Fixed invalid variable access in register.py (#3433)
* Fixed invalid variable access in register.py

The register_restricted_path and register_template_path methods did not specify the parameter for project path

Updated register_o3de_object_path function to pass in absolute paths to the engine or project in order to make relative paths to the registered o3de object to it.

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Fixed register_*_path resolve calls in register.py

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>
2021-08-25 13:29:24 -05:00
Esteban Papp f94043dc83 Adds functions so targets can define install directories/files 2021-08-24 15:12:02 -07:00
Chris Burel 86770deefa Add linux equivalents for all the places that enumerate platforms (#3325)
* Add linux equivalents for all the places that enumerate platforms

Signed-off-by: Chris Burel <burelc@amazon.com>

* Fix the AssetFileInfoListComparisonTest fixture to not hardcode the PC platform

Signed-off-by: Chris Burel <burelc@amazon.com>
2021-08-24 14:10:59 -07:00
Shirang Jia ce85bb3b7d Add awsi deployment as a non-blocking step in nightly pipeline (#3397)
* Add awsi deployment as a non-blocking step in nightly pipeline

* Make step fail if it's not a non-blocking step
2021-08-24 10:43:17 -07:00
Esteban Papp dc8b48601c PR comments/improvements
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
2021-08-24 10:36:31 -07:00
Esteban Papp b609d5e2cb supporting multiple directories
automatically excluding obvious things
cleanup and verification

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
2021-08-23 19:41:57 -07:00
Mike Chang a92684c0b8 Jenkinsfile LFS fix for iOS/Mac pulls (#3396)
* Add git lfs install and pull into Jenkins Git pull stage

Signed-off-by: Mike Chang <changml@amazon.com>
2021-08-23 16:07:02 -07:00
Esteban Papp 8bc9ed3d01 removing some rad leftovers (#3366)
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
2021-08-20 13:39:51 -07:00
hultonha a529256274 Add extra logging for CHANGE_ID and COMMIT_ID - TIAF
Merge pull request #3328 from aws-lumberyard-dev/jenkins_commit_hash_log
2021-08-20 10:45:41 +01:00
Junbo Liang c93a18ab82 Update the AWS automation tests to use existing CloudFormation stacks (#3092) 2021-08-19 14:05:25 -07:00
John dcde3f3e36 Add extra logging for CHANGE_ID and COMMIT_ID.
Signed-off-by: John <jonawals@amazon.com>
2021-08-19 18:18:45 +01:00
Esteban Papp a1b59e5e5e install reorg/cleanup
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
2021-08-19 08:51:29 -07:00
Shirang Jia e48798fdbf Add missing {} for string interpolation (#3291) 2021-08-18 10:02:24 -07:00
Shirang Jia 3e51240a05 Allow customized Jenkins parameters for different pipelines and add aws integration deployment pipeline (#3248)
Allow customized Jenkins parameters for different pipelines so that we can define different Jenkins parameters for a new pipeline and doesn't affect AR build parameters.

Add aws integration deployment pipeline.
2021-08-17 15:25:32 -07:00
jonawals 252c268ffd Fix corrupt merge. (#3142)
* Further subdivide TIAF data by suite.
* Key fix typo.

Signed-off-by: John <jonawals@amazon.com>
2021-08-16 16:09:36 +01:00
jonawals 5925bd22f6 Further subdivide TIAF data by suite. (#3128)
* Further subdivide TIAF data by suite.
* Key fix typo.

Signed-off-by: John <jonawals@amazon.com>
2021-08-16 14:15:02 +01:00
evanchia 78d34e6960 Adds the MARS benchmark script in AR
Signed-off-by: evanchia <evanchia@amazon.com>
2021-08-13 14:10:43 -07:00
John a1d855a920 Invert corner case flag for readability.
Signed-off-by: John <jonawals@amazon.com>
2021-08-13 10:03:09 +01:00