Commit Graph

38 Commits (8401ee409bb1bdeb9b3828a4d4a7189f7d412dc4)

Author SHA1 Message Date
jromnoa 47a8dbc1d0
Adds Atom component tests into the new parallel + batched test approach (#4039)
* create PoC for starting point for parallel + batched Atom tests

Signed-off-by: jromnoa <jromnoa@amazon.com>

* CMakeLists.txt update

Signed-off-by: jromnoa <jromnoa@amazon.com>

* saving progress on re-factor for parallel and batched tests, added Tracer(), added Report(), and added new exit code validation method but code is unfinished still

Signed-off-by: jromnoa <jromnoa@amazon.com>

* finalize conversion of component tests into new optimized test setup for batched/parallel runs

Signed-off-by: jromnoa <jromnoa@amazon.com>

* fix REDO deletion check, remove class referencing a test not yet added to parallel runs

Signed-off-by: jromnoa <jromnoa@amazon.com>

* revert hydra_AtomEditorComponents_AddedToEntity.py back to its original version

Signed-off-by: jromnoa <jromnoa@amazon.com>

* re-add the DepthOfField component to expected_lines for non-optimized main suite (removed on accident)

Signed-off-by: jromnoa <jromnoa@amazon.com>

* remove test comments from legal header, add EditorEntity() class, remove hydra calls - updated for Decal component, but the next commit will get the rest

Signed-off-by: jromnoa <jromnoa@amazon.com>

* saving progress on converting over fully to using EditorEntity() per PR comments - almost done, will finish tomorrow

Signed-off-by: jromnoa <jromnoa@amazon.com>

* add new test setup docstring, fix the create entity test step wording, re-add accidental removal of string text from editor_entity_utils.py

Signed-off-by: jromnoa <jromnoa@amazon.com>

* finalize PR concerns, use EditorEntity object for most/all calls, tests pass when run

Signed-off-by: jromnoa <jromnoa@amazon.com>

* remove accidental change

Signed-off-by: jromnoa <jromnoa@amazon.com>

* update helper.open_level() call to not include 'Physics' in path, remove unnecessary f-string calls

Signed-off-by: jromnoa <jromnoa@amazon.com>

* editor_python_test_tools.asset_utils.Asset.find_asset_by_path(), add is_hidden() and is_visible() to editor_python_test_tools to use for verification, clean up UNDO/REDO comments, fix test order in file to match the order of the test files

Signed-off-by: jromnoa <jromnoa@amazon.com>
4 years ago
smurly a5306f10f3
Reflection Probe component added to AtomEditorComponents test (#4135)
Signed-off-by: Scott Murray <scottmur@amazon.com>
4 years ago
galibzon 169b8f3679
[ATOM-5441] Shader Builders May Fail When Multiple New Files Are Added (#3862)
* [ATOM-5441] Shader Builders May Fail When Multiple
New Files Are Added

ShaderAssetBuilder::CreateJobs now recursively parses *.azsl files
looking for #include lines and builds the list of source dependencies
using a depth-first algorithm. It was using MCPP before but not anymore
(during CreateJobs).

The new algorithm may over prescribe, but fixes the issues
when multiple new shader related files are added, at once or out of order, to a game project
or Gem.

Overall the new ShaderAssetBuilder::CreateJobs() is around 40% faster
and, of course, handles source dependencies in a robust way.

* Added new test suite to AutomatedTesting project:
Gem/PythonTests/atom_renderer/test_Atom_ShaderBuildPipelineSuite.py

Bug fix to Gems/Atom/Asset/Shader/Code/Source/Editor/ShaderAssetBuilder.cpp
discovered thanks to the automated test suite. The idea is that
CreateJobs doesn't fail if the AZSL file doesn't exist. The failure is
deferred during ProcessJob. This way if the AZSL file exists the .shader
file is rebuilt automatically.

* For testability purposes and avoid memory leakage errors
during Unit Tests created the class ShaderBuilderUtility::IncludedFilesParser

Now accepts "#  include <file>" with space between '#' and 'include'.
Also now accepts the '-' character inside the file path.

Added Unit Test to validate all cases of "#include <file>" parsing.

* Fixed linux runtime issues for Unit Tests in Atom_Asset_Shader.Tests

Signed-off-by: garrieta <garrieta@amazon.com>
4 years ago
mrieggeramzn 603e33d7f7
Removing the boundary search method. (#4024)
* Removing the boundary search method. Bicubic is now the default and only PCF filtering method

* Removing padding (based upon feedback)

* Removing PCF method from py auto testing

Signed-off-by: mrieggeramzn <mriegger@amazon.com>
4 years ago
jromnoa a5f9cc2d61 use wait_for_condition() on newly created material cache files and wait for them to exist before continuing to prevent race condition
Signed-off-by: jromnoa <jromnoa@amazon.com>
5 years ago
jromnoa 0ae25fe7e7 add extra timeout value as well as some extra time.sleep() calls in an attempt to fix the test (seems race condition related)
Signed-off-by: jromnoa <jromnoa@amazon.com>
5 years ago
Chris Galvan 1c7f71f93a Updated Atom automated test that uses the PostFX Radius Weight Modifier.
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
jromnoa 63a78b906a
fixes light component GPU test AttributeError (I forgot to update atom_component_helper to atom_constants since constants were split from hydra functions into a new module) (#3115)
Signed-off-by: jromnoa <jromnoa@amazon.com>
5 years ago
smurly 2564e8f8dc
MaterialEditor BasicTests added to AutomatedTesting for AR (#3022)
* MaterialEditor BasicTests added to AutomatedTesting for AR

Signed-off-by: Scott Murray <scottmur@amazon.com>

* launch_and_validate_results adding a waiter.wait_for to the log monitor so the log file exists

Signed-off-by: Scott Murray <scottmur@amazon.com>
5 years ago
jromnoa 6d1bb8e439
Add Light component GPU (screenshot) test to AutomatedTesting nightly o3de runs. (#2923)
* adds the Light component GPU screenshot test to AutomatedTesting

Signed-off-by: jromnoa <jromnoa@amazon.com>

* add LIGHT_TYPE_PROPERTY constant to test script since it is re-used multiple times

Signed-off-by: jromnoa <jromnoa@amazon.com>

* removes redundant f strings, adds LIGHT_COMPONENT and LIGHT_TYPE_PROPERTY constants for re-use, removed formattng errors, increase CMakeLists.txt timeout, add attach_component_to_entity() to hydra_editor_utils.py

Signed-off-by: jromnoa <jromnoa@amazon.com>

* fix ImportError

Signed-off-by: jromnoa <jromnoa@amazon.com>

* moves the LIGHT_TYPES constant to a new file since scripts rely on it that do not have the Editor launched (can't see hydra bindings so failes with ModuleNotFound error)

Signed-off-by: jromnoa <jromnoa@amazon.com>
5 years ago
Cynthia Lin c1a0b5c686
performance benchmarks: Aggregate and report CPU frame times. (#2939)
* Add CaptureCpuFrameTime method to ProfilingCaptureSystemComponent for monitoring CPU performance.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* ly_test_tools: Refactor benchmark data aggregator in preparation for CPU frame times.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* performance benchmarks: Aggregate and report CPU frame times based on JSON data.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* AutomatedTesting: Capture CPU frame time in AtomFeatureIntegrationBenchmark.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
5 years ago
jromnoa a0f3379999
Adds Light component tests (non-GPU portion) to AutomatedTesting from AtomTest (#2758)
* Fixed Vegetation Layer Spawner documentation link.

Signed-off-by: Chris Galvan <chgalvan@amazon.com>
Signed-off-by: jromnoa <jromnoa@amazon.com>

* add remaining non-GPU test portions for Light component test

Signed-off-by: jromnoa <jromnoa@amazon.com>

* make non-GPU light component test more robust

Signed-off-by: jromnoa <jromnoa@amazon.com>

* remove redundant logging, convert LIGHT_TYPES from list to dict, remove redundant f-string

Signed-off-by: jromnoa <jromnoa@amazon.com>

Co-authored-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
Cynthia Lin 567b4a7f28
[ATOM-16016] Add initial level for AtomFeatureIntegrationBenchmark to AutomatedTesting. (#2405)
* [ATOM-16016] Add initial level for AtomFeatureIntegrationBenchmark to AutomatedTesting.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* [ATOM-16016] Add new AtomFeatureIntegrationBenchmark to AutomatedTesting.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
5 years ago
Steve Pham 38261d0800
Shorten copyright headers by splitting into 2 lines (#2213)
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines

Signed-off-by: Steve Pham <spham@amazon.com>
5 years ago
Chris Galvan b9e06e70d9 Fixed copyright header issues per new validator
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
Chris Galvan d7574777a8 Resolved merge conflicts
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
Steve Pham b4a2edec6a
Final update copyright headers to reference license files at the repo root (#1693)
* Final update copyright headers to reference license files at the repo root

Signed-off-by: spham <spham@amazon.com>

* Fix copyright validator unit tests to support the stale O3DE header scenario

Signed-off-by: spham <spham@amazon.com>
5 years ago
Gene Walters 9814e9dc6c Adding missing o3de copyright headers
Signed-off-by: Gene Walters <genewalt@amazon.com>
5 years ago
Gene Walters 4e14c0069b Merge branch 'upstream/stabilization/2106' into genewalt/gitflow_210628 5 years ago
jromnoa 33801ef925 fixes the nightly GPU test 5 years ago
Steve Pham 70042fcdcd
O3DE Copyright Updates for Linux Foundation (#1504) 5 years ago
jromnoa d904f6ab40 adds GPU test to the nightly test runs for o3de 5 years ago
jromnoa fbb5565fb5 removes hydra idle_wait() calls in an attempt to fix the timeout issue 5 years ago
jromnoa 0dd6d81985 small accidental typo fix 5 years ago
jromnoa 6f22cfd20b fix timeout values for general.idle_wait() and add Trace::Assert check with Trace::Error check, remove the 'failed to open' check (not needed) 5 years ago
jromnoa c3fe375e8f add some extra general.idle_wait() and general.idle_wait_frames() calls to increase test stability to stop race condition / intermittent failure in test 5 years ago
Terry Michaels 2fc130d4ab
Removed legacy render components (#421)
Removed legacy render components
5 years ago
jromnoa e1b55d8f0a change property call to the new Atom properties for Decal (Atom) 5 years ago
jromnoa 019eacc073 fix Decal component name due to crash in SPEC-6561 5 years ago
jromnoa bf70ccaa39 remove unused import 5 years ago
jromnoa 8c54cf8633 increase test timeout and add missing test case IDs 5 years ago
jromnoa 811dc9c446 remove unused TestAllComponentsBasicTests class, fix test_case_id markers to be comma separated, lowered CMake timeout to 5 minutes, use existing after_level_load() utility function, remove redundant comments 5 years ago
jromnoa f2a2286a2c remove GPU requirements, clean up test verification 5 years ago
jromnoa 32d643fe95 enable NullRenderer for test, clean-up some test verifications 5 years ago
jromnoa a9913cc079 remove shadowtest level, swap test to components test instead 5 years ago
jromnoa 22e9abf6a0 add ShadowTest map with its assets and update the hydra test + test scripts with correct paths 5 years ago
jromnoa 7623d28995 update tool_dependencies.cmake, CMakeLists.txt, hydra script 5 years ago
jromnoa ab7f40e991 add AtomTest levels, add some updated test configuration options, still need to debug an error with a tool dependency 5 years ago