Commit Graph

97 Commits (4e699138b8033b63843d6814d819786c2fd05e86)

Author SHA1 Message Date
jckand-amzn a3868068d5 Merge branch 'development' of https://github.com/o3de/o3de into jckand/EditorAutomationOptimization 4 years ago
Esteban Papp f94043dc83
Adds functions so targets can define install directories/files 4 years ago
jckand-amzn b466788cc4 Updating editor_test.py to allow for per-test null_renderer overrides
Signed-off-by: jckand-amzn <jckand@amazon.com>
4 years ago
AMZN-AlexOteiza 426ba2f4a6
Added conversion of physics tests using new optimizations. Fixed issue on editor test framework to close the AP correctly (#3145)
* Commit

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed xfail

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Fix for ap not closing for optimized tests

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* renamed tests to _Optimized

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Added xfail so the test will run in jenkins without affecting outcomes

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
4 years ago
Sean Sweeney f9c2dd62f7
Merge pull request #3363 from aws-lumberyard-dev/remote_console_fix
Adds a verification response for the remote console connecting
4 years ago
Esteban Papp b609d5e2cb supporting multiple directories
automatically excluding obvious things
cleanup and verification

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
4 years ago
evanchia eabd963e28 Fixed comment in remote console unit test
Signed-off-by: evanchia <evanchia@amazon.com>
4 years ago
Esteban Papp 8bc9ed3d01
removing some rad leftovers (#3366)
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
4 years ago
evanchia 8d6df19592 fixes a flaky lytesttools unit test
Signed-off-by: evanchia <evanchia@amazon.com>
4 years ago
evanchia a68f5c53c9 Adds a verification response for the remote console connecting
Signed-off-by: evanchia <evanchia@amazon.com>
4 years ago
Esteban Papp a1b59e5e5e install reorg/cleanup
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
4 years ago
AMZN-AlexOteiza 4b68e6c766
Added support for pytest marks, including skipping of tests (#2353)
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
4 years ago
Cynthia Lin c1a0b5c686
performance benchmarks: Aggregate and report CPU frame times. (#2939)
* Add CaptureCpuFrameTime method to ProfilingCaptureSystemComponent for monitoring CPU performance.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* ly_test_tools: Refactor benchmark data aggregator in preparation for CPU frame times.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* performance benchmarks: Aggregate and report CPU frame times based on JSON data.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* AutomatedTesting: Capture CPU frame time in AtomFeatureIntegrationBenchmark.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
4 years ago
Cynthia Lin b21b0e12e4
fix: Switch local environment detection to depend on BUILD_NUMBER instead of CI (#2962)
CI is only available on Jenkins v2.289.1, nightly builds are still run on Jenkins 2.277.4

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
4 years ago
Cynthia Lin 72cecfaaae
performance metrics: Upload benchmark results to local index for locally-run builds. (#2816)
Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
4 years ago
sharmajs-amzn 69bde80de3
Nighly build test fixes (#2727)
Signed-off-by: sharmajs-amzn <82233357+sharmajs-amzn@users.noreply.github.com>
4 years ago
Cynthia Lin 61f91d4a9a
Move benchmark data aggregation from ASV into ly_test_tools module. (#2335)
* fix: Correct typo in profiling capture system.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* Move benchmark data aggregation from ASV into ly_test_tools module.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
4 years ago
AMZN-AlexOteiza b815c203da
(Continuation) Implemented automation paralellization & standarization (#1718)
Engine improvements/fixes

Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:

Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
4 years ago
scspaldi 414bbb5b2a Handled merge conflict.
Signed-off-by: scspaldi <scspaldi@amazon.com>
4 years ago
Steve Pham 38261d0800
Shorten copyright headers by splitting into 2 lines (#2213)
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines

Signed-off-by: Steve Pham <spham@amazon.com>
4 years ago
scspaldi b2a4cf711e Removed AutomatedLauncherTesting Gem and LauncherTestTools.
Signed-off-by: scspaldi <scspaldi@amazon.com>
4 years ago
Royal OBrien 1061e17b36
Merge pull request #2112 from AMZN-scspaldi/scspaldi_cleanupLuaWindow
Added Lua Editor window to kill process list.
4 years ago
Sean Sweeney 9e81cedf80
Merge pull request #1979 from aws-lumberyard-dev/system_test_example_update
System test example update
4 years ago
evanchia 12a8cc7cd7 Removing deleted test from CMakeLists and updated in line comments for sample test
Signed-off-by: evanchia <evanchia@amazon.com>
4 years ago
scspaldi 6d2fbacda5 Added Lua Editor window to kill process list.
Signed-off-by: scspaldi <scspaldi@amazon.com>
4 years ago
Cynthia Lin eb9304c28d
Preparation for automated benchmarks (#1923)
* ly_test_tools: Add filebeat_client module from o3de-mars.

Slightly modified with default parameters and exceptions in order to act as an individual component.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* scripts: Remove timestamp_aggregator.py to prepare for moving into ASV automated test repository.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
4 years ago
evanchia ca29b95371 Merge branch 'development' into system_test_example_update 4 years ago
evanchia bc7e12278c changed nullrenderer arg for sanity test
Signed-off-by: evanchia <evanchia@amazon.com>
4 years ago
Chris Galvan 3b1873b045 Merged stabilization/2106 -> development (resolved merge conflicts).
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
4 years ago
evanchia 9067fc3b99 Updating/Removing LyTestTools sample tests
Signed-off-by: evanchia <evanchia@amazon.com>
4 years ago
evanchia 6308d01456 Minor changes to system example test to match docs
Signed-off-by: evanchia <evanchia@amazon.com>
4 years ago
nvsickle dee591921e Fix exception bubble-up
Signed-off-by: nvsickle <nvsickle@amazon.com>
5 years ago
nvsickle 3549e5b946 More fussing with logs
Signed-off-by: nvsickle <nvsickle@amazon.com>
5 years ago
nvsickle 3ee15f1912 Try to get some actual log output out of this
Signed-off-by: nvsickle <nvsickle@amazon.com>
5 years ago
hultonha 2ea9bfb144 merge stabilization/2106 into development
Signed-off-by: hultonha <hultonha@amazon.co.uk>
5 years ago
lumberyard-employee-dm b11cd2d17f
O3DE License Scan Updates (#1808)
* Removing Tools/Redistributable folder
None of the files within it are used by O3DE or are needed for
distribution at all

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Removing the GetGlyphRangesJapanese function from imgui_draw.cpp

That function is licensed under the
Creative Commons Attribution-ShareAlike 2.1 Japan (CC BY-SA 2.1 JP)

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>
5 years ago
Chris Galvan d7574777a8 Resolved merge conflicts
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
5 years ago
Steve Pham b4a2edec6a
Final update copyright headers to reference license files at the repo root (#1693)
* Final update copyright headers to reference license files at the repo root

Signed-off-by: spham <spham@amazon.com>

* Fix copyright validator unit tests to support the stale O3DE header scenario

Signed-off-by: spham <spham@amazon.com>
5 years ago
amzn-hdoke be519bb36a
Allow overriding of AWSAttribution settings to skip consent dialog for automated testing (#1650)
Signed-off-by: dhrudesh <dhrudesh@amazon.com>
5 years ago
Esteban Papp d14229c67e some replacements and fixes that were referring Sandbox/Editor
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
5 years ago
Terry Michaels 149863c527
Removed Amazon as Company for QSettings (#1649)
* Removed Amazon as Company for QSettings

Signed-off-by: Terry Michaels <miterenc@amazon.com>
5 years ago
Gene Walters 4e14c0069b Merge branch 'upstream/stabilization/2106' into genewalt/gitflow_210628 5 years ago
Terry Michaels 7a2a2dc0d7
Updated branding for application names (#1617) 5 years ago
evanchia-ly-sdets e9e740e355
Merge pull request #1527 from aws-lumberyard-dev/linux_sanity_fix
fixing linux sanity tests
5 years ago
Steve Pham 70042fcdcd
O3DE Copyright Updates for Linux Foundation (#1504) 5 years ago
Nicholas Van Sickle b032177418
Merge pull request #1443 from aws-lumberyard-dev/nvsickle/MergeStabilizationJun18
Merge stabilization/2106 into development
5 years ago
evanchia-ly-sdets 989178d285
Merge pull request #1377 from aws-lumberyard-dev/test_tools_example_test
Fixing test tools example test
5 years ago
nvsickle e55580af57 Merge remote-tracking branch 'upstream/stabilization/2106' into nvsickle/MergeStabilizationJun18 5 years ago
evanchia 3310110b9a Fixing test tools example test 5 years ago
evanchia cf7f1defeb added warning message 5 years ago