Commit Graph

432 Commits

Author SHA1 Message Date
LesaelR caf161ec63 Signed-off-by: LesaelR <LesaelR@amazon.com> (#4278)
* Signed-off-by: LesaelR <LesaelR@amazon.com>

* Removing the un-needed sandbox marks.

Signed-off-by: LesaelR <LesaelR@amazon.com>
2021-09-24 15:14:31 -05:00
mrieggeramzn 50fabb1bf7 Atom/mriegger/fixupname (#4187)
* Removing atom from the Decal (atom) name
* Decal component can take advantage of non-uniform scale option
* Using the base class nonuniform scale property rather than firing an event
* removing pragma optimize off
* Python tests need the updated name

Signed-off-by: mrieggeramzn <mriegger@amazon.com>
2021-09-21 15:06:55 -07:00
jromnoa fa163f49b9 Re-structure Atom test folders in AutomatedTesting. (#4206)
* move shader asset builder test into test_Atom_MainSuite_Optimized.py, update CMakeLists.txt, and move all imports inside the test class for hydra_ShaderAssetBuilder_RecompilesShaderAsChainOfDependenciesChanges.py

Signed-off-by: jromnoa <jromnoa@amazon.com>

* re-organize the Atom automated test structure to match the new parallel + batched test structures

Signed-off-by: jromnoa <jromnoa@amazon.com>

* fix CMakeLists.txt registrations for test files

Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-09-21 10:55:48 -07:00
jromnoa 3685f1bff2 move shader asset builder test into test_Atom_MainSuite_Optimized.py, update CMakeLists.txt, and move all imports inside the test class for hydra_ShaderAssetBuilder_RecompilesShaderAsChainOfDependenciesChanges.py (#4205)
Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-09-20 15:21:23 -07:00
jckand-amzn e4479fff4a Dynamic Vegetation automated test conversion/optimization (#4175)
* Initial batch of optimized Dynamic Vegetation tests

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Adding another round of optimized Dynamic Vegetation tests

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Adding more optimized Dynamic Vegetation tests

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Adding another round of optimized Dynamic Vegetation tests

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Final batch of converted Dynamic Vegetation tests

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Re-organizing/cleaning up TestSuite files

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Running optimized tests without xfail marker for Jenkins test

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Corrected path on CMakeLists.txt to point to the correct TestSuite file for optimized tests

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Adding xfail mark to DistanceBetweenFilter tests due to Editor deadlock

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Updating CMakeLists to build Launcher

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Updating xfail for DistanceBetweenFilter tests to skips as they timeout and cause cascading test failures

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Re-added xfail marker to optimized tests

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Correcting a few typos

Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-09-20 15:08:43 -05:00
jckand-amzn a4424ea820 Adding xfail mark to LayerBlender test due to Launcher crash on quit (#4173)
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-09-20 10:49:04 -05:00
Junbo Liang ac5cc04b59 [AWSI Automation] Export more AWS resource names via CloudFormation stack outputs for the automation tests (#4161)
* Read resources name via CloudFormation stack outputs and trim resource names when they are too long

Signed-off-by: Junbo Liang <junbo@amazon.com>
2021-09-16 13:52:27 -07:00
jromnoa 47a8dbc1d0 Adds Atom component tests into the new parallel + batched test approach (#4039)
* create PoC for starting point for parallel + batched Atom tests

Signed-off-by: jromnoa <jromnoa@amazon.com>

* CMakeLists.txt update

Signed-off-by: jromnoa <jromnoa@amazon.com>

* saving progress on re-factor for parallel and batched tests, added Tracer(), added Report(), and added new exit code validation method but code is unfinished still

Signed-off-by: jromnoa <jromnoa@amazon.com>

* finalize conversion of component tests into new optimized test setup for batched/parallel runs

Signed-off-by: jromnoa <jromnoa@amazon.com>

* fix REDO deletion check, remove class referencing a test not yet added to parallel runs

Signed-off-by: jromnoa <jromnoa@amazon.com>

* revert hydra_AtomEditorComponents_AddedToEntity.py back to its original version

Signed-off-by: jromnoa <jromnoa@amazon.com>

* re-add the DepthOfField component to expected_lines for non-optimized main suite (removed on accident)

Signed-off-by: jromnoa <jromnoa@amazon.com>

* remove test comments from legal header, add EditorEntity() class, remove hydra calls - updated for Decal component, but the next commit will get the rest

Signed-off-by: jromnoa <jromnoa@amazon.com>

* saving progress on converting over fully to using EditorEntity() per PR comments - almost done, will finish tomorrow

Signed-off-by: jromnoa <jromnoa@amazon.com>

* add new test setup docstring, fix the create entity test step wording, re-add accidental removal of string text from editor_entity_utils.py

Signed-off-by: jromnoa <jromnoa@amazon.com>

* finalize PR concerns, use EditorEntity object for most/all calls, tests pass when run

Signed-off-by: jromnoa <jromnoa@amazon.com>

* remove accidental change

Signed-off-by: jromnoa <jromnoa@amazon.com>

* update helper.open_level() call to not include 'Physics' in path, remove unnecessary f-string calls

Signed-off-by: jromnoa <jromnoa@amazon.com>

* editor_python_test_tools.asset_utils.Asset.find_asset_by_path(), add is_hidden() and is_visible() to editor_python_test_tools to use for verification, clean up UNDO/REDO comments, fix test order in file to match the order of the test files

Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-09-16 10:59:23 -07:00
jckand-amzn b95e170f9e Marking DistanceBetweenFilter tests with xfail due to Editor deadlock (#4156)
* Marking DistanceBetweenFilter tests with xfail due to Editor deadlock

Signed-off-by: jckand-amzn <jckand@amazon.com>

* Updating xfail mark

Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-09-16 10:53:38 -05:00
Junbo Liang c50f3b2638 Fix the destruction failure and update the instructions for running automation tests (#4124)
Signed-off-by: Junbo Liang <junbo@amazon.com>
2021-09-15 14:03:45 -07:00
smurly a5306f10f3 Reflection Probe component added to AtomEditorComponents test (#4135)
Signed-off-by: Scott Murray <scottmur@amazon.com>
2021-09-15 14:27:26 -04:00
galibzon 169b8f3679 [ATOM-5441] Shader Builders May Fail When Multiple New Files Are Added (#3862)
* [ATOM-5441] Shader Builders May Fail When Multiple
New Files Are Added

ShaderAssetBuilder::CreateJobs now recursively parses *.azsl files
looking for #include lines and builds the list of source dependencies
using a depth-first algorithm. It was using MCPP before but not anymore
(during CreateJobs).

The new algorithm may over prescribe, but fixes the issues
when multiple new shader related files are added, at once or out of order, to a game project
or Gem.

Overall the new ShaderAssetBuilder::CreateJobs() is around 40% faster
and, of course, handles source dependencies in a robust way.

* Added new test suite to AutomatedTesting project:
Gem/PythonTests/atom_renderer/test_Atom_ShaderBuildPipelineSuite.py

Bug fix to Gems/Atom/Asset/Shader/Code/Source/Editor/ShaderAssetBuilder.cpp
discovered thanks to the automated test suite. The idea is that
CreateJobs doesn't fail if the AZSL file doesn't exist. The failure is
deferred during ProcessJob. This way if the AZSL file exists the .shader
file is rebuilt automatically.

* For testability purposes and avoid memory leakage errors
during Unit Tests created the class ShaderBuilderUtility::IncludedFilesParser

Now accepts "#  include <file>" with space between '#' and 'include'.
Also now accepts the '-' character inside the file path.

Added Unit Test to validate all cases of "#include <file>" parsing.

* Fixed linux runtime issues for Unit Tests in Atom_Asset_Shader.Tests

Signed-off-by: garrieta <garrieta@amazon.com>
2021-09-15 07:50:14 -05:00
mrieggeramzn 603e33d7f7 Removing the boundary search method. (#4024)
* Removing the boundary search method. Bicubic is now the default and only PCF filtering method

* Removing padding (based upon feedback)

* Removing PCF method from py auto testing

Signed-off-by: mrieggeramzn <mriegger@amazon.com>
2021-09-14 18:10:06 -05:00
moraaar 6628f5bad1 Marking script canvas failing tests as xfail until they can be reworked to make them pass. (#4077)
Signed-off-by: moraaar <moraaar@amazon.com>
2021-09-13 15:22:00 +01:00
AMZN-AlexOteiza fd627af003 Merge pull request #4048 from aws-lumberyard-dev/automation_improv4
Renamed folder physics -> Physics
2021-09-13 13:26:16 +02:00
Junbo Liang 3535d6b6b3 [AWS Automation] Stack tear down mechanism for the deployment on Jenkins (#3656)
Make awsi_test_profile_vs2019 a nonblocking step to make sure that resources are cleaned up even though automation tests failed

Signed-off-by: Junbo Liang <junbo@amazon.com>
2021-09-10 12:56:41 -07:00
AMZN-AlexOteiza 78d0b46f08 Updated path in CMakeLists.txt
Signed-off-by: AMZN-AlexOteiza <aljanru@amazon.co.uk>
2021-09-10 14:39:43 +02:00
AMZN-AlexOteiza 5441ab4bac Rename to final folder name 2021-09-10 14:29:17 +02:00
AMZN-AlexOteiza ddd662f6b9 rename to tmp name 2021-09-10 14:28:40 +02:00
jromnoa 5c4ce8cd06 Upload test screenshots to s3 on test failure. (#3815)
* add s3 upload on screenshot test failure, should only apply to the test_gpu_profile_vs2019 job on nightly runs

* adds support for zipping screenshot files up prior to uploading to the s3 bucket and also adds the ACL extra arg to the upload_to_s3.py execution

* remove unused json import

* remove regex to use .endswith() instead and rename variables to be more clear (PR feedback)

* rename create_zip_archive to create_screenshots_archive

Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-09-08 06:11:44 -05:00
Junbo Liang 8edcc504bd Add AWSI automation tests to a new test suite and pipe (#3913)
Signed-off-by: junbo <junbo@amazon.com>
2021-09-07 13:02:13 -07:00
ANT\aljanru 9159eccb25 Fixes for periodic and gpu tests affected by the move 2021-09-06 17:03:10 +02:00
ANT\aljanru 73b9f1bb40 Removed comment for line 2021-09-06 11:42:39 +02:00
ANT\aljanru 44d2a9275f Blast tests 2021-09-05 23:37:55 +02:00
ANT\aljanru cdfaabc2ca Merge fix, removed editor preferences change by accident 2021-09-05 22:32:26 +02:00
ANT\aljanru 4220c52330 Standarization: Python files
Signed-off-by: ANT\aljanru <aljanru@amazon.co.uk>
2021-09-05 22:19:57 +02:00
chiyenteng f7d4d80e5b Add prefab reparenting python auto tests (#3653)
* Add prefab reparenting python auto tests

Signed-off-by: chiyteng <chiyteng@amazon.com>

* modify prefab python auto test framework

Signed-off-by: chiyteng <chiyteng@amazon.com>

* remove extra spaces

Signed-off-by: chiyteng <chiyteng@amazon.com>

* delete unused files

Signed-off-by: chiyteng <chiyteng@amazon.com>

* delete unused files

Signed-off-by: chiyteng <chiyteng@amazon.com>

* fix nits

Signed-off-by: chiyteng <chiyteng@amazon.com>

* Refactor prefab python tests

Signed-off-by: chiyteng <chiyteng@amazon.com>

* Fix nits

Signed-off-by: chiyteng <chiyteng@amazon.com>

* Modify comments

Signed-off-by: chiyteng <chiyteng@amazon.com>

* Fix nits and add comments for Prefab.py

Signed-off-by: chiyteng <chiyteng@amazon.com>
2021-09-03 14:06:22 -05:00
AMZN-AlexOteiza 2ca03367bb Re-added removed xfails by accident (#3901)
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
2021-09-03 18:32:15 +02:00
evanchia-ly-sdets 95f3477831 Moving physics test from sandbox to main (#3858)
Signed-off-by: evanchia <evanchia@amazon.com>
2021-09-02 12:08:37 +02:00
moraaar 9a0ea2c4c5 Fixed NvCloth assets, NvCloth automated test scripts, ModelAsset cloning and UI reverse overrides menu crash (#3851)
- Fixed cloth asset, which stopped working due to Updated skeleton logic: #2957 which changes how fbx graph nodes are collected (affecting its names, which is used by cloth modifier).
- Fixed cloth test suite active call to base's run_test function. It stopped working when its signature was changed here: 182d410#diff-3f5d93b0a76c838893693f19f2eacfe3e67040d445d6463c5c425ef5075cb409
- Renamed nvcloth TestSuite_Active.py to TestSuite_Main.py to be consistent with the other test folders.
- Fixed ModelAsset creator clone function. It was missing to copy the material slots, ultimately causing Material Component to show 0 material slots.
- Fixed crash where the revert overrides menu was not created when checking changes for selected component and selected entities.

Signed-off-by: moraaar moraaar@amazon.com
2021-09-02 09:35:12 +01:00
Guthrie Adams c9a3b51fa9 Merge pull request #3667 from aws-lumberyard-dev/Atom/jromnoa/add-waits-to-materialeditor-test
Attempt to fix potential race condition in test_MaterialEditorBasicTests() test.
2021-08-31 14:40:15 -05:00
AMZN-AlexOteiza 77e630085b Overhaul physics test organization (#3684)
* Moved files

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Fixes for moved files

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed tmp file

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
2021-08-31 11:04:24 +02:00
jromnoa a5f9cc2d61 use wait_for_condition() on newly created material cache files and wait for them to exist before continuing to prevent race condition
Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-08-30 17:56:23 -07:00
evanchia ce962415d2 Moving fixed smoke test from sandbox to smoke suite
Signed-off-by: evanchia <evanchia@amazon.com>
2021-08-30 14:20:51 -07:00
jromnoa cce532c99e remove EDITOR_TIMEOUT constant and manually enter each time value, sets an example for future patterns to NOT use a constant for this value
Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-08-30 12:40:09 -07:00
jromnoa ae68f669da Merge branch 'development' into Atom/jromnoa/add-waits-to-materialeditor-test 2021-08-30 12:37:58 -07:00
jckand-amzn ca94e961f7 Merge branch 'development' of https://github.com/o3de/o3de into jckand/LCGradOptimizations 2021-08-30 10:11:30 -05:00
jromnoa 0ae25fe7e7 add extra timeout value as well as some extra time.sleep() calls in an attempt to fix the test (seems race condition related)
Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-08-27 20:35:11 -07:00
Junbo Liang d39a6a9085 Read project, region and assume role ARN from environment and update the script canvas graphs to fix automation test failures (#3654)
Fix AWS periodic automation test.s
2021-08-27 15:17:41 -07:00
jckand-amzn b6aa317051 Merge branch 'development' of https://github.com/o3de/o3de into jckand/LCGradOptimizations 2021-08-27 10:02:04 -05:00
jromnoa 9f55212a19 Adds MaterialEditor RHI launch tests (#3558)
* adds MaterialEditor RHI launch tests

* add explicit editor_script parameter to the launch_and_validate_results() call

Signed-off-by: jromnoa <jromnoa@amazon.com>
2021-08-26 16:25:24 -05:00
jckand-amzn c30642d855 Renaming test files for standardization and setting optimized tests to run alongside existing
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-25 16:13:10 -05:00
jckand-amzn 082273b543 Whitespace cleanup
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 18:19:38 -05:00
jckand-amzn 789d5904da More test filename cleanup/re-org and enabled existing tests alongside optimized tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 18:18:19 -05:00
jckand-amzn cb1d680a56 Removing sandbox tests from main suite
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 16:43:16 -05:00
jckand-amzn 2f8d029832 Moving 2 tests to sandbox that are intermittently failing on Jenkins but passing locally
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 16:35:11 -05:00
jckand-amzn 4458a245d1 Adding xfail marker to test run, and updating CMakeLists to point to the optimized test file
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 16:19:01 -05:00
jckand-amzn fb39aa5b86 Removing old test files
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 16:14:15 -05:00
jckand-amzn 8c1ab46901 Removing unneeded periodic suite test file
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 16:02:01 -05:00
jckand-amzn fc44063a0a Renaming test files for standardization. Keeping old, unoptimized files temporarily.
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 16:00:45 -05:00