Commit Graph

392 Commits (d40af1c70c852aae6e8e4e3fd91f55d8fea8ec99)

Author SHA1 Message Date
evanchia 05728920f7 Replaced with imported functions for smoke tests
Signed-off-by: evanchia <evanchia@amazon.com>
5 years ago
evanchia d08cbd2c33 Moving load level test from sandbox to smoke with fixes
Signed-off-by: evanchia <evanchia@amazon.com>
5 years ago
Chris Galvan 7ec6feddb8
Merge pull request #2329 from aws-lumberyard-dev/jckand/VegDebuggerTestStabilization
Removing obsolete Vegetation Debugger test
5 years ago
AMZN-AlexOteiza b815c203da
(Continuation) Implemented automation paralellization & standarization (#1718)
Engine improvements/fixes

Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:

Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
5 years ago
moraaar fbb9ed6618
Merge pull request #2333 from aws-lumberyard-dev/Move_Undo_Redo_Test_Sandbox
Moving test_C15425929_Undo_Redo flaky test to sandbox test suite
5 years ago
moraaar caa4e30b38 Marking test_C15425929_Undo_Redo as xfail.
Signed-off-by: moraaar <moraaar@amazon.com>
5 years ago
moraaar a918b3d31a Moving test_C15425929_Undo_Redo flaky test to sandbox test suite
Signed-off-by: moraaar <moraaar@amazon.com>
5 years ago
jckand-amzn 7ebdde0be0 Adding xfail mark to test_LandscapeCanvas_GraphClosed_OnEntityDelete
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn 3050a4db47 Removing obsolete Vegetation Debugger test
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn dccab7df54 Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 5 years ago
jckand-amzn e0c94dcf45 Updating xfail reason for tests currently failing due to instance spawning with null renderer
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn 6fcf9aa9e1 Updated component configuration for new uniform scale in SlopeAlignmentModifier tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
Junbo Liang a32a521a80
Update automation tests for the AWS gems to reduce the run time (#2148)
Simplify the automation tests to reduce the time they cost on Jenkins
5 years ago
jckand-amzn 2173693462 Updating component configuration and expected instance counts for SlopeFilter test
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn d9874431e2 Moving test back to xfail due to remaining issues with instance planting on meshes while null renderer is enabled
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn 605c17072e Updating test suite for Position Modifier test
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn b7cb9fa5e3 Re-configured some component properties to account for uniform scaling in PositionModifier tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
amzn-mike fc75dd5fda
Fix python fbx tests (#2171)
* Update fbx test dbgsg files

Remove rc products from fbx test expected output
Update warning counts for 2 of the tests - these are due to missing material properties
Add SkipAtomOutput setting to disable atom material and mesh processing in scene as these pull in a lot of external dependencies to Process
Removed BlendShapeData and MeshData debug output of positions/normals/faces
Updated ManifestImportRequestHandler to remove warning about Joining 2 absolute paths
Updated AssImpMaterialImporter to use new GenerateRelativeSourcePath API to fix issue where relative path generation failed with tmp project directories

Signed-off-by: amzn-mike <80125227+amzn-mike@users.noreply.github.com>

* Add comment for setting

Signed-off-by: amzn-mike <80125227+amzn-mike@users.noreply.github.com>

* Add override dbgsg file to python test

The mesh optimizer specifically avoids creating optimized nodes for nodes that are not selected, resulting in a different scene graph that requires a different dbgsg file to compare with

Signed-off-by: amzn-mike <80125227+amzn-mike@users.noreply.github.com>

* Replace hardcoded passing of specific registry setting to instead pass all registry settings to AssetBuilder

Signed-off-by: amzn-mike <80125227+amzn-mike@users.noreply.github.com>
5 years ago
Steve Pham 38261d0800
Shorten copyright headers by splitting into 2 lines (#2213)
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines

Signed-off-by: Steve Pham <spham@amazon.com>
5 years ago
jckand-amzn ed788090d3
Adding xfail mark to test_LandscapeCanvas_GraphClosed_OnEntityDelete due to #2201 (#2208)
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn 4c8befe759
Removing obsolete Vegetation Debugger CVar test. CVars now function without the component present (#2200)
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
Esteban Papp 900b82cb36 missing dependencies
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
5 years ago
jckand-amzn 9fcc9f7b41 Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 5 years ago
jromnoa 900f37644e
fix Atom GPU test by enabling autotest_mode (#2117)
Signed-off-by: jromnoa <jromnoa@amazon.com>
5 years ago
Chris Galvan df9358c492
Merge pull request #2109 from aws-lumberyard-dev/cgalvan/RemoveDeprecatedGraphicsMenuItems
Removed deprecated graphics settings/performance menu options. Updated automated test accordingly.
5 years ago
Chris Galvan f278bbcd65
Merge pull request #2094 from aws-lumberyard-dev/cgalvan/gitflow_210712
Merged stabilization/2106 to development
5 years ago
Chris Galvan 2fc1062802 Removed deprecated graphics settings/performance menu options. Updated automated test accordingly.
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
jromnoa 6a6aa69762
increase test timeout, if it still times out I need to get RDP access to the node to fix this since a pop-up or alert is halting+timing out automation (#2041)
Signed-off-by: jromnoa <jromnoa@amazon.com>
5 years ago
Chris Galvan e924ed0b86 Merged stabilization/2106 to development; Resolved merge conflicts
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
jckand-amzn ceae858f09 Updating to use of psutil directly
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn 35a60cdf1a Removing unnecessary Mesh component refreshes and updating calls to scale meshes
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn ea99ed11a3 Updating mesh surface creation, filtering, and expected instance counts
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn 9f5e91be88 Updating utility path for test import, and updating linked issue to disabled test
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jromnoa a40c979baa move test to sandbox instead of disabling it
Signed-off-by: jromnoa <jromnoa@amazon.com>
5 years ago
Junbo Liang ededb85da2
Merge AWSCore automation tests to the development branch (#2011)
* Create AWS Core automation for the interacting with AWS resources via the AWS Core gem.
Signed-off-by: junbo <junbo@amazon.com>
Co-authored-by: clujames <clujames@amazon.com>
5 years ago
jckand-amzn 3679530562 Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 5 years ago
jromnoa 2555c88fe7 this test needs to be disabled in main, it was supposed to be merged to development before break but got merged to stabilization and then main
Signed-off-by: jromnoa <jromnoa@amazon.com>
5 years ago
Chris Galvan 3b1873b045 Merged stabilization/2106 -> development (resolved merge conflicts).
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
jckand-amzn c64f3fa5f9 Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 5 years ago
jckand-amzn ea0e38aaf4 Updating expected View menu options for test_Menus_ViewMenuOptions_Work
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn 0a68bbdf7c Updating camera position and null renderer args for launcher test
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
jckand-amzn dae44030fd Merge branch 'development' of https://github.com/o3de/o3de into jckand/DynVegXfailFixes 5 years ago
jckand-amzn 78752a23a7 Updating null renderer argument for launcher tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
sharmajs-amzn b9f70412c4
Moving flaky test test_WindowsAndMac_ComparisonOperations_Success to sandbox test suite (#1750)
Signed-off-by: sharmajs <sharmajs@amazon.com>
5 years ago
jckand-amzn c32f00d73f Updating/re-enabling skipped/xfailed Dynamic Vegetation automated tests
Signed-off-by: jckand-amzn <jckand@amazon.com>
5 years ago
hultonha 2ea9bfb144 merge stabilization/2106 into development
Signed-off-by: hultonha <hultonha@amazon.co.uk>
5 years ago
Aaron Ruiz Mora 9d5a9ff925
NvCloth automated tests use default renderer to be more stable and complete (#1850)
Signed-off-by: moraaar <moraaar@amazon.com>
5 years ago
Chris Galvan b9e06e70d9 Fixed copyright header issues per new validator
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
Chris Galvan d7574777a8 Resolved merge conflicts
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
chcurran 6b27c1d797 fix python test against editor
Signed-off-by: chcurran <82187351+carlitosan@users.noreply.github.com>
5 years ago
Steve Pham b4a2edec6a
Final update copyright headers to reference license files at the repo root (#1693)
* Final update copyright headers to reference license files at the repo root

Signed-off-by: spham <spham@amazon.com>

* Fix copyright validator unit tests to support the stale O3DE header scenario

Signed-off-by: spham <spham@amazon.com>
5 years ago
balibhan 6392788212
Merge pull request #1547 from aws-lumberyard-dev/build_game_launcher
Test game launcher with GPU
5 years ago
Gene Walters 9814e9dc6c Adding missing o3de copyright headers
Signed-off-by: Gene Walters <genewalt@amazon.com>
5 years ago
Gene Walters 6fb2558e44 Merge branch 'upstream/development' into genewalt/gitflow_210628
Signed-off-by: Gene Walters <genewalt@amazon.com>
5 years ago
Terry Michaels 149863c527
Removed Amazon as Company for QSettings (#1649)
* Removed Amazon as Company for QSettings

Signed-off-by: Terry Michaels <miterenc@amazon.com>
5 years ago
John 773fb4ea74 Add python test case to hydra test utils editor launcher
Signed-off-by: John <jonawals@amazon.com>
5 years ago
John 0e0f266fdd Provisional implementation of PythonCoverage gem
Signed-off-by: John <jonawals@amazon.com>
5 years ago
jromnoa 3e659b5107 fixes the nightly GPU test
Signed-off-by: John <jonawals@amazon.com>
5 years ago
Gene Walters 4e14c0069b Merge branch 'upstream/stabilization/2106' into genewalt/gitflow_210628 5 years ago
darapan 19695cfd12 "Fixing review comments" 5 years ago
darapan 0c468e4c31 "Adding new line" 5 years ago
darapan 0ef72afdba "Resoved Merge Conflicts" 5 years ago
darapan ce143a31f6 Merge branch 'stabilization/2106' into build_game_launcher 5 years ago
darapan ae9e3737c1 "" 5 years ago
darapan 7d833b87a5 "Resoving merge conflcts" 5 years ago
darapan 72ed95f095 "Resolving merge conflicts" 5 years ago
darapan aaf3edb467 "Fixing review comments" 5 years ago
Esteban Papp 1c5a4a3230
LYN-4759 Check test timeout max on smoke and main suites only (#1501) 5 years ago
darapan d3516053f3 "Fixing review comments" 5 years ago
darapan 0d60018000 "Updating cmake" 5 years ago
jackalbe 143b8f1131
{SPEC-7465} Fix DeleteCachedAssets_AssetsReprocessed fails on Debug Nightly Builds (#1535)
* Fix for DeleteCachedAssets_AssetsReprocessed fails on Debug Nightly Builds
* added -ap_disableAssetTreeView=true to disable the Qt tree view for the asset tab to get the parts that want to be tested finish
* only shows up on Debug

Tests:
=== test session starts ===
AutomatedTesting/Gem/PythonTests/assetpipeline/asset_processor_tests/asset_processor_batch_tests_2.py::TestsAssetProcessorBatch_AllPlatforms::test_AllSupportedPlatforms_FastScanWorks_FasterThanFullScan[windows-AutomatedTesting] PASSED [ 50%]
AutomatedTesting/Gem/PythonTests/assetpipeline/asset_processor_tests/asset_processor_batch_tests_2.py::TestsAssetProcessorBatch_Windows::test_WindowsPlatforms_RunAPBatchAndConnectGui_RunsWithoutEditor[windows-AutomatedTesting] PASSED [100%]
--- generated xml file: F:\amazon\o3de\build\vs2019\Testing\Pytest\AssetPipelineTests.Batch_2_Sandbox.xml ---
=== 2 passed, 4 deselected in 18.32s ===
5 years ago
jackalbe 95313401ed
{SPEC-7398} Helios - Asset Bundler auto test fixes (#1444)
* using O3DE engine assets instead of level.pak
* updated the binary find() logic for DeltaCatalog.xml

Tests: AutomatedTesting/Gem/PythonTests/assetpipeline/asset_processor_tests/asset_bundler_batch_tests.py
5 years ago
darapan d443a6f5c2 "Adding new line at the end" 5 years ago
darapan 9ae11c3602 "Adding new test" 5 years ago
jromnoa 33801ef925 fixes the nightly GPU test 5 years ago
Steve Pham 70042fcdcd
O3DE Copyright Updates for Linux Foundation (#1504) 5 years ago
sharmajs-amzn 64533431d8
{SPEC-7412}AssetPipelineTests.Gui_2_Main.main fails in nightly build (#1481) 5 years ago
amzn-hdoke 35001eba09
Fix resource mappings file names and client auth warnings and asserts. Fix cdk permissions (#1487)
* Fix resource mappings file names and client auth warnings and asserts conditions

* Add comments to explain reasoning for client auth role permissions

* Update comments based on feedback

* Fix AWSClientAuth unit test
5 years ago
mbalfour df648db62e Merge branch 'stabilization/2106' into mbalfour/gitflow_210622
# Conflicts:
#	Code/Framework/AzQtComponents/AzQtComponents/Components/Style.cpp
#	Code/Framework/AzToolsFramework/AzToolsFramework/Viewport/ViewportMessages.h
#	Gems/AWSCore/Code/Source/Editor/UI/AWSCoreEditorMenu.cpp
5 years ago
jckand-amzn 3fb3836b54 Simplifying test filtering in CMakeLists 5 years ago
jckand-amzn 4c294c0931 Merge branch 'stabilization/2106' of https://github.com/aws-lumberyard/o3de into jckand/FoundationAutoStabilization 5 years ago
jromnoa 2020ad7f64
Merge pull request #1442 from aws-lumberyard-dev/Atom/jromnoa/ATOM-15424-add-some-gpu-tests-to-AutomatedTesting
ATOM-15424: Adds GPU tests to the nightly o3de runs for the AutomatedTesting project (Windows only)
5 years ago
sphrose a8ba1a99af Update BasicEditorWorkflows_LevelEntityComponentCRUD.py 5 years ago
jromnoa 43b253da56 main suite and not sandbox suite, since the nightly runs the main suite 5 years ago
nvsickle e55580af57 Merge remote-tracking branch 'upstream/stabilization/2106' into nvsickle/MergeStabilizationJun18 5 years ago
amzn-hdoke 04f6c7b90f
Enable AWSI Automation Tests (#1330)
* Add AWS AutomatedTesting levels

* Update AWSCoreConfiguration to use default profile

* Update lambda name

* Add cdk update command before tests run

* Update global cdk version before runnign tests.

* Add npm update command

* More cdk changes

* More cdk changes

* Shortening project names for cdk

* increase timeout for AWSTests

* Add comments

* Set AWSTests to periodic test suite

* Update logic to re install cdk and deploy bootstrap

* change version to list to catch version mismatch

* Move AWS fixtures to module directory scope

* Fixing issues with cdk utils

* Add cdk setup to be called on cdk fixture function
5 years ago
jromnoa d904f6ab40 adds GPU test to the nightly test runs for o3de 5 years ago
amzn-sean 84de2d2e12
Fixed failing periodic physics tests (#1429) 5 years ago
jckand-amzn 67cd1ff52f Ensuring Main suite tests don't run GPU tests 5 years ago
Aaron Ruiz Mora 7781307afe
Fixed cloth automated tests. (#1400)
Bone transforms buffer is not valid when using Null renderer, which caused the test to fail since it reported an error and ultimately crashing as well. For now it's been worked around by checking the pointer is valid and not printing the error when null renderer is used, a task for the Atom team has been created to fix this properly in the future (ATOM-15807).
5 years ago
jckand-amzn d9f899cc50 Merge branch 'stabilization/2106' of https://github.com/aws-lumberyard/o3de into jckand/FoundationAutoStabilization 5 years ago
Aaron Ruiz Mora b9fbfac967
Fixed Physics Materials periodic automated tests (#1396) 5 years ago
jckand-amzn e4d42bd62b Merge branch 'stabilization/2106' of https://github.com/aws-lumberyard/o3de into jckand/FoundationAutoStabilization 5 years ago
amzn-sean 9f62d631fb
Physics joints updated to the new API (#1361)
Co-authored-by: Ulugbek Adilbekov <ulugbek@amazon.com>
5 years ago
jckand-amzn 6cf3a26574 Duplicating test to run on GPU node 5 years ago
sharmajs-amzn 6d608c2297
{SPEC-6460} BuildReleaseAuxiliaryContent fails to execute (#1341)
* Removing Auxiliary tests

* removing auxiliary test from running
5 years ago
jckand-amzn b31de1da33 LYN-4518: Updating expected actions for test_Menus_ViewMenuOptions_Work 5 years ago
evanchia-ly-sdets 3e0b0582ea
Merge pull request #1214 from aws-lumberyard-dev/enable_smoke_test
enabling smoke test
5 years ago
evanchia 258741b4c9 enabling smoke test 5 years ago
FuzzyCarterAWS 9cc8e95945 Updates FBX test assets to remove suzanne 5 years ago