Commit Graph

382 Commits (b815c203da1dc231d17ba2d559d8a920e69c6642)

Author SHA1 Message Date
AMZN-AlexOteiza b815c203da
(Continuation) Implemented automation paralellization & standarization (#1718)
Engine improvements/fixes

Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:

Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
4 years ago
moraaar fbb9ed6618
Merge pull request #2333 from aws-lumberyard-dev/Move_Undo_Redo_Test_Sandbox
Moving test_C15425929_Undo_Redo flaky test to sandbox test suite
4 years ago
moraaar caa4e30b38 Marking test_C15425929_Undo_Redo as xfail.
Signed-off-by: moraaar <moraaar@amazon.com>
4 years ago
moraaar a918b3d31a Moving test_C15425929_Undo_Redo flaky test to sandbox test suite
Signed-off-by: moraaar <moraaar@amazon.com>
4 years ago
jckand-amzn dccab7df54 Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 4 years ago
jckand-amzn e0c94dcf45 Updating xfail reason for tests currently failing due to instance spawning with null renderer
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jckand-amzn 6fcf9aa9e1 Updated component configuration for new uniform scale in SlopeAlignmentModifier tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
Junbo Liang a32a521a80
Update automation tests for the AWS gems to reduce the run time (#2148)
Simplify the automation tests to reduce the time they cost on Jenkins
4 years ago
jckand-amzn 2173693462 Updating component configuration and expected instance counts for SlopeFilter test
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jckand-amzn d9874431e2 Moving test back to xfail due to remaining issues with instance planting on meshes while null renderer is enabled
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jckand-amzn 605c17072e Updating test suite for Position Modifier test
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jckand-amzn b7cb9fa5e3 Re-configured some component properties to account for uniform scaling in PositionModifier tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
amzn-mike fc75dd5fda
Fix python fbx tests (#2171)
* Update fbx test dbgsg files

Remove rc products from fbx test expected output
Update warning counts for 2 of the tests - these are due to missing material properties
Add SkipAtomOutput setting to disable atom material and mesh processing in scene as these pull in a lot of external dependencies to Process
Removed BlendShapeData and MeshData debug output of positions/normals/faces
Updated ManifestImportRequestHandler to remove warning about Joining 2 absolute paths
Updated AssImpMaterialImporter to use new GenerateRelativeSourcePath API to fix issue where relative path generation failed with tmp project directories

Signed-off-by: amzn-mike <80125227+amzn-mike@users.noreply.github.com>

* Add comment for setting

Signed-off-by: amzn-mike <80125227+amzn-mike@users.noreply.github.com>

* Add override dbgsg file to python test

The mesh optimizer specifically avoids creating optimized nodes for nodes that are not selected, resulting in a different scene graph that requires a different dbgsg file to compare with

Signed-off-by: amzn-mike <80125227+amzn-mike@users.noreply.github.com>

* Replace hardcoded passing of specific registry setting to instead pass all registry settings to AssetBuilder

Signed-off-by: amzn-mike <80125227+amzn-mike@users.noreply.github.com>
4 years ago
Steve Pham 38261d0800
Shorten copyright headers by splitting into 2 lines (#2213)
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines

Signed-off-by: Steve Pham <spham@amazon.com>
4 years ago
jckand-amzn ed788090d3
Adding xfail mark to test_LandscapeCanvas_GraphClosed_OnEntityDelete due to #2201 (#2208)
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jckand-amzn 4c8befe759
Removing obsolete Vegetation Debugger CVar test. CVars now function without the component present (#2200)
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jjjoness facd1e18b5
One hamburger menu to rule them all (#2232)
* Icon changes

Signed-off-by: John Jones-Steele <jjjoness@amazon.com>

* Icon changes to svg files

Signed-off-by: John Jones-Steele <jjjoness@amazon.com>
4 years ago
Esteban Papp 900b82cb36 missing dependencies
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
4 years ago
jckand-amzn 9fcc9f7b41 Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 4 years ago
jromnoa 900f37644e
fix Atom GPU test by enabling autotest_mode (#2117)
Signed-off-by: jromnoa <jromnoa@amazon.com>
4 years ago
Chris Galvan df9358c492
Merge pull request #2109 from aws-lumberyard-dev/cgalvan/RemoveDeprecatedGraphicsMenuItems
Removed deprecated graphics settings/performance menu options. Updated automated test accordingly.
4 years ago
Chris Galvan f278bbcd65
Merge pull request #2094 from aws-lumberyard-dev/cgalvan/gitflow_210712
Merged stabilization/2106 to development
4 years ago
Chris Galvan 2fc1062802 Removed deprecated graphics settings/performance menu options. Updated automated test accordingly.
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
4 years ago
jromnoa 6a6aa69762
increase test timeout, if it still times out I need to get RDP access to the node to fix this since a pop-up or alert is halting+timing out automation (#2041)
Signed-off-by: jromnoa <jromnoa@amazon.com>
4 years ago
Chris Galvan e924ed0b86 Merged stabilization/2106 to development; Resolved merge conflicts
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
4 years ago
jckand-amzn ceae858f09 Updating to use of psutil directly
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jckand-amzn 35a60cdf1a Removing unnecessary Mesh component refreshes and updating calls to scale meshes
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jckand-amzn ea99ed11a3 Updating mesh surface creation, filtering, and expected instance counts
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jckand-amzn 9f5e91be88 Updating utility path for test import, and updating linked issue to disabled test
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
jromnoa a40c979baa move test to sandbox instead of disabling it
Signed-off-by: jromnoa <jromnoa@amazon.com>
4 years ago
Junbo Liang ededb85da2
Merge AWSCore automation tests to the development branch (#2011)
* Create AWS Core automation for the interacting with AWS resources via the AWS Core gem.
Signed-off-by: junbo <junbo@amazon.com>
Co-authored-by: clujames <clujames@amazon.com>
4 years ago
jckand-amzn 3679530562 Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 4 years ago
jromnoa 2555c88fe7 this test needs to be disabled in main, it was supposed to be merged to development before break but got merged to stabilization and then main
Signed-off-by: jromnoa <jromnoa@amazon.com>
4 years ago
lumberyard-employee-dm 097dc25424
Fixed the discovery of the dependencies of gem variant aliases which (#2013)
alias INTERFACE LIBRARY targets.

This was causing the dependent Atom_AtomBridge sub gems from not being
found when generating the cmake_dependencies.*.setreg file containing
the list of gem modules to load

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>
4 years ago
Chris Galvan 3b1873b045 Merged stabilization/2106 -> development (resolved merge conflicts).
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
4 years ago
jckand-amzn c64f3fa5f9 Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 4 years ago
jckand-amzn ea0e38aaf4 Updating expected View menu options for test_Menus_ViewMenuOptions_Work
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
Chris Galvan 30f8c75613
Merge pull request #1908 from aws-lumberyard-dev/cgalvan/FixLegacyCryIcons
Fixed legacy launcher/mac/ios icons and removed some remaining unused Editor icons.
5 years ago
jckand-amzn 0a68bbdf7c Updating camera position and null renderer args for launcher test
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn dae44030fd Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 5 years ago
jckand-amzn 78752a23a7 Updating null renderer argument for launcher tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
lumberyard-employee-dm 02922806a5
Updated gem.json for all top-level Gems. (#1715) (#1917)
* Updated gem.json for all top-level Gems. All the top level gems now have identical gem.json formats based on the DefautlGem template gem.json. Two additional fields have been added, a type: field and a requirements: field. These fields are for display in Project Mananger. All gem.json files have a default requirements: value of None. Devs are responsible for providing requirements. Gem descriptions and tags have been signed off by developers.

Signed-off-by: Cronin <mikecro@amazon.com>

* Fixed minor formatting issues with RADTelemetry gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to QtForPython gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to the Twitch gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to AWSCore gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to the AtomTressFX gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to the end of the AudioEngineWwise gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to the end of the CertificateManager gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Removing extra whitespace in summary of CrashReporting gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to the end of the CustomAssetExample gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Removing extra whitespace in editorPythonBindings gem summary

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to the end of the ScriptedEntityTweener gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to the end of the Gestures gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Removing extra whitetspace in the summary of the GameStateSamples gem

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Adding newline to the end of the ExpressionEvaluation gem.json

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Updated the ProjectManager PythonBindings.cpp code to reference the
newer fields in the gem.json files

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Updating the Gem and Project templates gem.json files to include the
"type" and the "requirements" field.

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Updated the default "requirments" field value to be empty string instead
of "None"

This works better with the ProjectManager GemInfoFromPath function.

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Correcting "summary" field name

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Added the requirements text to the AudioEngineWwise Gem

This gem requires downloading the Wwise 3rdParty library from AudioKinetic's website

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

Co-authored-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

Co-authored-by: Mike Cronin <58789750+micronAMZN@users.noreply.github.com>
5 years ago
sharmajs-amzn b9f70412c4
Moving flaky test test_WindowsAndMac_ComparisonOperations_Success to sandbox test suite (#1750)
Signed-off-by: sharmajs <sharmajs@amazon.com>
5 years ago
jckand-amzn c32f00d73f Updating/re-enabling skipped/xfailed Dynamic Vegetation automated tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
Chris Galvan 635473e5cf [LYN-4990] Fixed legacy launcher/mac/ios icons and removed some remaining unused Editor icons.
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
hultonha 2f34a35aed removing .orig file from previous merge
Signed-off-by: hultonha <hultonha@amazon.co.uk>
5 years ago
hultonha 2ea9bfb144 merge stabilization/2106 into development
Signed-off-by: hultonha <hultonha@amazon.co.uk>
5 years ago
Aaron Ruiz Mora 9d5a9ff925
NvCloth automated tests use default renderer to be more stable and complete (#1850)
Signed-off-by: moraaar <moraaar@amazon.com>
5 years ago
amzn-hdoke 1dfe65a3ef
Update AWSNativeSDK-Android revision and enable AWS gems (#1837)
Signed-off-by: dhrudesh <dhrudesh@amazon.com>
5 years ago
Chris Galvan f47e71da36 Merged conflicts from pulling down latest development
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago