Changes between Version 19 and Version 20 of Testing
- Timestamp:
- 04/24/15 03:37:10 (6 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Testing
v19 v20 53 53 54 54 To create multiple output files which can be used to generate charts, using [http://xpra.org/trac/browser/xpra/trunk/src/tests/xpra/test_measure_perf_charts.py xpra.test_measure_perf_charts]: 55 56 * Determine the values of the following variables: prefix: (a string to identify the data set), id: (a string to identify the variable that the data set is testing, for example '14' because we're testing xpra v14 in this data set), repetitions: the number of times you want to run the tests. 57 * The data file names you will produce will then be in the format: prefix_id_rep.csv. 55 * Build a config class by taking a copy from [http://xpra.org/trac/browser/xpra/trunk/src/tests/xpra/perf_config_default.py xpra.perf_config_default.py], then making changes as necessary. 56 * Determine the values of the following variables: prefix: (a string to identify the data set), id: (a string to identify the variable that the data set is testing, for example '14' because we're testing xpra v14 in this data set), repetitions: the number of times you want to run the tests. 57 * The data file names you will produce will then be in the format: prefix_id_rep.csv. 58 58 * With this information in hand you can now create a script that will run the tests. 59 59 60 For example: 61 60 For example: 62 61 {{{ 63 ./test_measure_perf.py all_tests_40 ./data/all_tests_40_14_1.csv 1 14 > ./data//all_tests_40_14_1.log 64 ./test_measure_perf.py all_tests_40 ./data/all_tests_40_14_2.csv 2 14 > ./data//all_tests_40_14_2.log 62 ./test_measure_perf.py all_tests_40 ./data/all_tests_40_14_1.csv 1 14 > ./data//all_tests_40_14_1.log 63 ./test_measure_perf.py all_tests_40 ./data/all_tests_40_14_2.csv 2 14 > ./data//all_tests_40_14_2.log 65 64 }}} 66 65 67 66 In the above example, test_measure_perf is run twice, using a config class named "all_tests_40.py", and outputting the results to data files using the prefix "all_tests_40", for version 14. 68 69 The additional arguments "1 14", "2 14" are custom paramaters which will be written to the "Custom Params" column in the corresponding data files. 70 67 68 The additional arguments "1 14", "2 14" are custom paramaters which will be written to the "Custom Params" column in the corresponding data files. 69 71 70 The "1", "2" in the file names or in the parameters, refer to the corresponding repetition of the tests. 72 73 71 74 72 Please also see: