Commit Graph

110 Commits

Author SHA1 Message Date
sweeneys 2b7262f566 Mock additional popen calls
Signed-off-by: sweeneys <sweeneys@amazon.com>
2021-10-13 14:14:01 -07:00
sweeneys f1fa0acbb4 Stabilize asset processor immediately exiting
Signed-off-by: sweeneys <sweeneys@amazon.com>
2021-10-13 11:44:15 -07:00
Sean Sweeney 1ea472bdeb Merge pull request #4589 from aws-lumberyard-dev/lytt_integ_linux
Platform manager and sanity tests for Linux
2021-10-12 15:11:12 -07:00
Artur K 80db67e90a Remove many unused variables and unused setting files (#4607)
* Remove many unused variables and unused setting files

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>

* Remove a few more dead config vars

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>

* fix android test_ConfigureSettings_DefaultValues_SetsValues

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>
2021-10-12 17:06:15 -05:00
sweeneys 45def74409 Fix extension ignoring between Windows and Linux
Signed-off-by: sweeneys <sweeneys@amazon.com>
2021-10-11 11:11:40 -07:00
sweeneys 2034cd3053 Platform manager and sanity tests for Linux
Signed-off-by: sweeneys <sweeneys@amazon.com>
2021-10-08 15:36:52 -07:00
amzn-phist fec77632ef Archive Component - Rewrite and additional work on Archive and Asset Bundler (#4332)
* Fix issues with seedlist for AutomatedTesting

Fixes error reporting so it will show the file hint in the tool.
Removes any missing assets from the .seed file.
Remove an unnecessary dependency from AutomatedTesting dependencies
file.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Make ArchiveComponent use AZ::IO::IArchive

Initial changes that will get the sychronous calls in ArchiveComponent
to use IArchive interface rather than external zip/7z tools.

Some of the asynchronous api are still in place, anything that wasn't
being used has been removed for now.  This may change later if we move
towards all the api being asynchronous.  Until then, we can't remove the
reliance upon the external archive tools completely.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Updates AZStd::thread constructors

Adds a variadic constructor which forwards args to the functor.
Because of our thread_desc extension, there was confusion on the
arugments, so the args were reordered to take the thread_desc first,
before the functor and args.
Also the thread_desc is taken as reference rather than by pointer.
Update callsites to account for this change.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Async operation of ArchiveComponent api

This sets up the ArchiveComponent to operate asynchronously.  It uses
promise/future to transfer results to caller.

This is still broken, there's a few things that need to get fixed up,
but this is a good checkpoint for the work as it solidifies the api,
cleans up a bunch of unused code, and compiles.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Removes the platform-specific ArchiveComponen

These are no longer needed, as they control the direct interaction with
host OS tools like 7za.exe or /bin/zip.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Removes the platform-specific files from cmake

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Removes the 7za.exe (and legal notice)

This tool is no longer needed in the repo.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Fixes usage of IArchive::GetFullPath()

This changed to return a PathView, updated to reflect that.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Fix promises and threads

Make sure promises are only set exactly once.  This meant reworking some
of the initial error checking.
Detach threads when created.  Adds [[nodiscard]] to the functions that
return a future.  Since threads are detached, the future is the main way
to get communication from the thread.
Clean up interface, add comments.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* More edits to thread creation

Changes to thread construction to account for parameter change.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Fix some remaining issues with ArchiveComponent

Put created threads inside a container, then join them at Deactivate.
Fix asset bundler case when injecting a file with no working directory.
Fix thread constructor that applies args to a function.
Fix lambdas to take string args by value rather than reference.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Fixes some remaining bugs in ArchiveComponent

Open archive as read-only during extract & list operations.
Fixes paths issues.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Fix initialize of opaque thread handle in thread_UnixLike.h

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Removed unused variable in AssetBundleComponent.cpp to fix compiler warning

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Fix some issues with archives

File paths in the CDR and the local headers need to match, but there
were issues with path separators and case that made it possible to get
invalid headers errors in some archives.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Adds some new ArchiveComponent unit tests

Adds new tests for extraction of archive and adding files from a file
list to an archive.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Fix file data offset issues when opening archives

When opening an INestedArchive it would run through the CDR headers to
create file entries in the zip cache.  The offsets to the compressed
data were being calculated incorrectly because they were using the CDR
headers rather than jumping to the local file headers and getting
offsets from those sizes.

Removed and refactored some archive validation flow and zip cache
factory init methods to either init default or init w/ additional
validation checks.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Addresses PR feedback

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Address more points of feedback in PR

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Address additional PR feedback

 Fixes up some error checks and uses of strings vs paths.
 Enable archive component tests on Linux so we can see if they will
 pass.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Address PR feedback

Change the INestedArchive interface to list files as AZ::IO::Path.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Disabling the ArchiveComponent tests on Linux

They failed so we will revisit them to attempt a fix.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Rename a member variable to be more accurate

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Address feedback on PR

Bump version of Archive Components for serialize context.
Improve error messages during archive open and validation.

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

* Revert recent changes

Signed-off-by: amzn-phist <52085794+amzn-phist@users.noreply.github.com>

Co-authored-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>
2021-10-01 10:15:16 -05:00
Sean Sweeney a8559c4000 Merge pull request #4374 from aws-lumberyard-dev/lytt_linux_tests
Lytt linux tests
2021-09-29 09:31:44 -07:00
sweeneys f6585a741c docstring updates
Signed-off-by: sweeneys <sweeneys@amazon.com>
2021-09-28 14:55:16 -07:00
evanchia bcf024edf9 registering linux integ test to cmake
Signed-off-by: evanchia <evanchia@amazon.com>
2021-09-27 14:33:08 -07:00
evanchia 4998f44246 adding process_utils linux integ test
Signed-off-by: evanchia <evanchia@amazon.com>
2021-09-27 14:25:43 -07:00
sweeneys 09ce73aa44 Initial update for this module's unit tests on Linux
Signed-off-by: sweeneys <sweeneys@amazon.com>
2021-09-22 17:50:38 -07:00
AMZN-AlexOteiza d784ff8c57 Added debugger attachment utilities to the engine, fixed crash when showing console variables, improvements to timeout handling and small cleanup (#3591)
* Added debugger attachment utilities to the engine, fixed crash when showing console variables

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unused variables

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unneded check

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Small fix for crashes/timeouts

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unused variable, fixed compile error

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Fix compile

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Addressed esteban comments

* Addressed tom comments

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
2021-08-31 10:27:14 +02:00
jckand-amzn a3868068d5 Merge branch 'development' of https://github.com/o3de/o3de into jckand/EditorAutomationOptimization 2021-08-25 11:33:17 -05:00
Esteban Papp f94043dc83 Adds functions so targets can define install directories/files 2021-08-24 15:12:02 -07:00
jckand-amzn b466788cc4 Updating editor_test.py to allow for per-test null_renderer overrides
Signed-off-by: jckand-amzn <jckand@amazon.com>
2021-08-24 16:10:36 -05:00
AMZN-AlexOteiza 426ba2f4a6 Added conversion of physics tests using new optimizations. Fixed issue on editor test framework to close the AP correctly (#3145)
* Commit

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed xfail

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Fix for ap not closing for optimized tests

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* renamed tests to _Optimized

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Added xfail so the test will run in jenkins without affecting outcomes

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
2021-08-24 20:54:48 +02:00
Sean Sweeney f9c2dd62f7 Merge pull request #3363 from aws-lumberyard-dev/remote_console_fix
Adds a verification response for the remote console connecting
2021-08-24 11:12:30 -07:00
Esteban Papp b609d5e2cb supporting multiple directories
automatically excluding obvious things
cleanup and verification

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
2021-08-23 19:41:57 -07:00
evanchia eabd963e28 Fixed comment in remote console unit test
Signed-off-by: evanchia <evanchia@amazon.com>
2021-08-23 16:00:23 -07:00
Esteban Papp 8bc9ed3d01 removing some rad leftovers (#3366)
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
2021-08-20 13:39:51 -07:00
evanchia 8d6df19592 fixes a flaky lytesttools unit test
Signed-off-by: evanchia <evanchia@amazon.com>
2021-08-20 09:15:14 -07:00
evanchia a68f5c53c9 Adds a verification response for the remote console connecting
Signed-off-by: evanchia <evanchia@amazon.com>
2021-08-19 17:54:48 -07:00
Esteban Papp a1b59e5e5e install reorg/cleanup
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
2021-08-19 08:51:29 -07:00
AMZN-AlexOteiza 4b68e6c766 Added support for pytest marks, including skipping of tests (#2353)
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
2021-08-10 10:08:16 +02:00
Cynthia Lin c1a0b5c686 performance benchmarks: Aggregate and report CPU frame times. (#2939)
* Add CaptureCpuFrameTime method to ProfilingCaptureSystemComponent for monitoring CPU performance.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* ly_test_tools: Refactor benchmark data aggregator in preparation for CPU frame times.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* performance benchmarks: Aggregate and report CPU frame times based on JSON data.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* AutomatedTesting: Capture CPU frame time in AtomFeatureIntegrationBenchmark.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
2021-08-09 14:57:52 -07:00
Cynthia Lin b21b0e12e4 fix: Switch local environment detection to depend on BUILD_NUMBER instead of CI (#2962)
CI is only available on Jenkins v2.289.1, nightly builds are still run on Jenkins 2.277.4

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
2021-08-09 10:32:31 -07:00
Cynthia Lin 72cecfaaae performance metrics: Upload benchmark results to local index for locally-run builds. (#2816)
Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
2021-08-05 14:59:09 -07:00
sharmajs-amzn 69bde80de3 Nighly build test fixes (#2727)
Signed-off-by: sharmajs-amzn <82233357+sharmajs-amzn@users.noreply.github.com>
2021-08-03 11:15:23 -07:00
Cynthia Lin 61f91d4a9a Move benchmark data aggregation from ASV into ly_test_tools module. (#2335)
* fix: Correct typo in profiling capture system.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* Move benchmark data aggregation from ASV into ly_test_tools module.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
2021-07-26 12:25:50 -07:00
AMZN-AlexOteiza b815c203da (Continuation) Implemented automation paralellization & standarization (#1718)
Engine improvements/fixes

Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:

Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
2021-07-22 12:57:23 +02:00
scspaldi 414bbb5b2a Handled merge conflict.
Signed-off-by: scspaldi <scspaldi@amazon.com>
2021-07-19 11:50:36 -07:00
Steve Pham 38261d0800 Shorten copyright headers by splitting into 2 lines (#2213)
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines

Signed-off-by: Steve Pham <spham@amazon.com>
2021-07-16 15:25:48 -07:00
scspaldi b2a4cf711e Removed AutomatedLauncherTesting Gem and LauncherTestTools.
Signed-off-by: scspaldi <scspaldi@amazon.com>
2021-07-16 12:39:17 -07:00
Royal OBrien 1061e17b36 Merge pull request #2112 from AMZN-scspaldi/scspaldi_cleanupLuaWindow
Added Lua Editor window to kill process list.
2021-07-15 19:03:36 -04:00
Sean Sweeney 9e81cedf80 Merge pull request #1979 from aws-lumberyard-dev/system_test_example_update
System test example update
2021-07-14 16:59:01 -07:00
evanchia 12a8cc7cd7 Removing deleted test from CMakeLists and updated in line comments for sample test
Signed-off-by: evanchia <evanchia@amazon.com>
2021-07-12 15:31:09 -07:00
scspaldi 6d2fbacda5 Added Lua Editor window to kill process list.
Signed-off-by: scspaldi <scspaldi@amazon.com>
2021-07-12 13:43:41 -07:00
Cynthia Lin eb9304c28d Preparation for automated benchmarks (#1923)
* ly_test_tools: Add filebeat_client module from o3de-mars.

Slightly modified with default parameters and exceptions in order to act as an individual component.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* scripts: Remove timestamp_aggregator.py to prepare for moving into ASV automated test repository.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
2021-07-09 11:28:18 -07:00
evanchia ca29b95371 Merge branch 'development' into system_test_example_update 2021-07-09 10:17:15 -07:00
evanchia bc7e12278c changed nullrenderer arg for sanity test
Signed-off-by: evanchia <evanchia@amazon.com>
2021-07-08 15:55:06 -07:00
Chris Galvan 3b1873b045 Merged stabilization/2106 -> development (resolved merge conflicts).
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
2021-07-08 13:56:47 -05:00
evanchia 9067fc3b99 Updating/Removing LyTestTools sample tests
Signed-off-by: evanchia <evanchia@amazon.com>
2021-07-08 11:55:46 -07:00
evanchia 6308d01456 Minor changes to system example test to match docs
Signed-off-by: evanchia <evanchia@amazon.com>
2021-07-08 11:53:03 -07:00
nvsickle dee591921e Fix exception bubble-up
Signed-off-by: nvsickle <nvsickle@amazon.com>
2021-07-07 11:51:25 -07:00
nvsickle 3549e5b946 More fussing with logs
Signed-off-by: nvsickle <nvsickle@amazon.com>
2021-07-07 11:51:24 -07:00
nvsickle 3ee15f1912 Try to get some actual log output out of this
Signed-off-by: nvsickle <nvsickle@amazon.com>
2021-07-07 11:51:22 -07:00
hultonha 2ea9bfb144 merge stabilization/2106 into development
Signed-off-by: hultonha <hultonha@amazon.co.uk>
2021-07-06 17:34:04 +01:00
lumberyard-employee-dm b11cd2d17f O3DE License Scan Updates (#1808)
* Removing Tools/Redistributable folder
None of the files within it are used by O3DE or are needed for
distribution at all

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>

* Removing the GetGlyphRangesJapanese function from imgui_draw.cpp

That function is licensed under the
Creative Commons Attribution-ShareAlike 2.1 Japan (CC BY-SA 2.1 JP)

Signed-off-by: lumberyard-employee-dm <56135373+lumberyard-employee-dm@users.noreply.github.com>
2021-07-02 14:58:31 -05:00
Chris Galvan d7574777a8 Resolved merge conflicts
Signed-off-by: Chris Galvan <chgalvan@amazon.com>
2021-07-02 12:42:44 -05:00