aboutsummaryrefslogtreecommitdiff
path: root/src/nvim/testdir/runtest.vim
Commit message (Collapse)AuthorAge
* vim-patch:8.2.0400: not all tests using a terminal are in the list of flaky ↵Jan Edmund Lazo2021-03-23
| | | | | | | | | | | | | | | | | | | | | | | | | | | tests Problem: Not all tests using a terminal are in the list of flaky tests. Solution: Introduce the test_is_flaky flag. https://github.com/vim/vim/commit/3cdcb090a664e182078f7cc0ca3e4e5a94bbb784 Cherry-pick g:test_is_flaky from patch v8.2.0557. Ensure that test_is_flaky variable is set from the global scope.. N/A patches for version.c: vim-patch:8.2.2647: terminal test sometimes hangs Problem: Terminal test sometimes hangs. Solution: Wait for the shell to display a prompt. https://github.com/vim/vim/commit/f4a2ed071447ad4984fad55b9d1671b55140ae1c vim-patch:8.2.2648: terminal resize test sometimes hangs Problem: Terminal resize test sometimes hangs. Solution: Wait for the shell to display a prompt and other output. https://github.com/vim/vim/commit/c54f347d63bcca97ead673d01ac6b59914bb04e5 fixup! vim-patch:8.2.0400: not all tests using a terminal are in the list of flaky tests
* test/old: cherry-pick patch v8.1.1955 changes for test_trycatch.vimJan Edmund Lazo2020-12-11
|
* vim-patch:8.2.1384: no ATTENTION prompt for :vimgrep first match fileJan Edmund Lazo2020-10-17
| | | | | | | Problem: No ATTENTION prompt for :vimgrep first match file. Solution: When there is an existing swap file do not keep the dummy buffer. (closes vim/vim#6649) https://github.com/vim/vim/commit/8ce4b7ed85a7c6499bea5eb1312c85ee7a00e364
* vim-patch:8.2.1315: MS-Windows: test log contains escape sequencesJan Edmund Lazo2020-08-30
| | | | | | | Problem: MS-Windows: test log contains escape sequences. Solution: Do not use t_md and t_me but ANSI escape sequences. (Ken Takata, closes vim/vim#6559) https://github.com/vim/vim/commit/45df2a01a79d562b59949383f79625bb8bd89a69
* vim-patch:8.2.1033: not easy to read the test time in the test outputJan Edmund Lazo2020-08-30
| | | | | | Problem: Not easy to read the test time in the test output. Solution: Align the times. Make slow tests bold. https://github.com/vim/vim/commit/8d9437968b6693ecb14e7375bcb242e657e75266
* vim-patch:8.2.0423: in some environments a few tests are expected to failJan Edmund Lazo2020-08-23
| | | | | | | Problem: In some environments a few tests are expected to fail. Solution: Add $TEST_MAY_FAIL to list tests that should not cause make to fail. https://github.com/vim/vim/commit/ce436de5a9b94886baf023b3d22193cc68d0e9d1
* vim-patch:8.1.2364: termwinscroll test is flaky on FreeBSDJan Edmund Lazo2020-08-23
| | | | | | Problem: Termwinscroll test is flaky on FreeBSD. Solution: Add to list of flaky tests. Rename function. https://github.com/vim/vim/commit/e219f73ed546abeba1ff4f5c08b380d648852222
* vim-patch:8.1.2089: do not get a hint that $TEST_FILTER was activeJan Edmund Lazo2020-08-23
| | | | | | Problem: Do not get a hint that $TEST_FILTER was active. Solution: Mention $TEST_FILTER if no functions were executed. https://github.com/vim/vim/commit/7b666c7883c905a0e1428b8bfa7ba062af2656e7
* vim-patch:8.1.2051: double-click test is a bit flakyJan Edmund Lazo2020-08-23
| | | | | | Problem: Double-click test is a bit flaky. Solution: Correct entry in list of flaky tests. https://github.com/vim/vim/commit/705918f9f7e446287923cf0248ea35f2a0688199
* vim-patch:8.1.1677: tests get stuck when running into an existing swapfileJan Edmund Lazo2020-08-23
| | | | | | | Problem: Tests get stuck when running into an existing swapfile. Solution: Set v:swapchoice to "q" and report an error. (Daniel Hahler, closes vim/vim#4644) https://github.com/vim/vim/commit/b073da8929ae0c03c403197197ed6b57f0f3d3be
* vim-patch:8.1.1516: time reported for a test measured wrongJan Edmund Lazo2020-08-23
| | | | | | | Problem: Time reported for a test measured wrong. Solution: Move the computation to the end of RunTheTest(). (Ozaki Kiichi, closes vim/vim#4520) https://github.com/vim/vim/commit/640d4f0c97e686211dc4474b46a83e4435d883c0
* vim-patch:8.2.1267: MS-Windows: tests may fail due to $PROMPT valueJan Edmund Lazo2020-08-02
| | | | | | Problem: MS-Windows: tests may fail due to $PROMPT value. Solution: Set $PROMPT for testing. (Taro Muraoka, closes vim/vim#6510) https://github.com/vim/vim/commit/2690b5aed8b6b6070430b05dcae296cd9479c942
* vim-patch:8.1.1484: some tests are slowDaniel Hahler2020-05-25
| | | | | | | Problem: Some tests are slow. Solution: Add timing to the test messages. Fix double free when quitting in VimLeavePre autocmd. https://github.com/vim/vim/commit/75ee544f99ca66be8105570c6309d95435ad30d1
* vim-patch:8.1.1581: shared functions for testing are disorganisedJan Edmund Lazo2020-05-03
| | | | | | Problem: Shared functions for testing are disorganised. Solution: Group finctions in script files. (Ozaki Kiichi, closes vim/vim#4573) https://github.com/vim/vim/commit/7a39dd7f00239059ce34660611589b26126a550c
* vim-patch:8.1.2087: cannot easily select one test function to executeJan Edmund Lazo2019-12-29
| | | | | | | Problem: Cannot easily select one test function to execute. Solution: Support the $TEST_FILTER environment variable. (Ozaki Kiichi, closes vim/vim#2695) https://github.com/vim/vim/commit/a7f6c3cf071bb6267e0bd2eb3d27ca240381ba87
* vim-patch:8.1.1951: mouse double click test is a bit flakyJan Edmund Lazo2019-11-22
| | | | | | Problem: Mouse double click test is a bit flaky. Solution: Add to list of flaky tests. Update a couple of comments. https://github.com/vim/vim/commit/f1699968baf3619a4147b44c891ba4a0985e7656
* vim-patch:8.1.2329: mouse multiple click test is a bit flakyJan Edmund Lazo2019-11-22
| | | | | | Problem: Mouse multiple click test is a bit flaky. Solution: Add it to the list of flaky tests. https://github.com/vim/vim/commit/44f0bd878ab6525eb50f2e05a13c0854164cdec2
* vim-patch:8.1.2151: state test is a bit flakyJan Edmund Lazo2019-10-18
| | | | | | Problem: State test is a bit flaky. Solution: Add to the list of flaky tests. https://github.com/vim/vim/commit/3c8cd4a1dcbc34d8818a2a38b1d1e4755da9edc2
* vim-patch:8.1.2162: popup resize test is flakyJan Edmund Lazo2019-10-18
| | | | | | Problem: Popup resize test is flaky. (Christian Brabandt) Solution: Add the function to the list of flaky tests. https://github.com/vim/vim/commit/4e03933726e3698d962bf7dacdd27f306a4c5086
* vim-patch:8.1.2074: test for SafeState autocommand is a bit flakyJan Edmund Lazo2019-10-01
| | | | | | Problem: Test for SafeState autocommand is a bit flaky. Solution: Add to list of flaky tests. https://github.com/vim/vim/commit/0d0c3ca007940cdb64ccbfd0e70846eedfe6a4a6
* tests: use runtime from build for doc/tags with :help (#10479)Daniel Hahler2019-08-28
| | | | | | | | | | | | This is better practice in general, and allows to remove the "helptags ALL" hacks. Ref: https://github.com/neovim/neovim/issues/8824 Ref: https://github.com/neovim/neovim/commit/f1b67c3453c * Makefile: fix dependencies with regard to helptags - use the file as the main target to avoid unnecessary triggering - use "make oldtest" on Travis to ensure it gets built
* vim-patch:8.1.1476: no statistics displayed after running testsDaniel Hahler2019-08-22
| | | | | | | | | | Problem: No statistics displayed after running tests. Solution: Summarize the test results. (Christian Brabandt, closes vim/vim#4391) Also make it possible to report a skipped file. https://github.com/vim/vim/commit/9c0cec65f891492314caadeef87a50251a21e630 Removes our custom no-inits from `$(RUN_VIMTEST)`, since we have `$(NO_INITS)` now also.
* vim-patch:8.1.0811: too many #ifdefsDaniel Hahler2019-08-22
| | | | | | Problem: Too many #ifdefs. Solution: Graduate FEAT_MBYTE, the final chapter. https://github.com/vim/vim/commit/30276f2beb248557c6b33cd5418bca8b7084b0a5
* Merge #10679 from erw7/fix-oldtest-on-windowsJustin M. Keyes2019-08-18
|\
| * Change to set shellslash to test under same conditions as vimerw72019-08-17
| |
* | vim-patch:8.1.1839: insufficient info when test fails because of screen sizeJan Edmund Lazo2019-08-17
| | | | | | | | | | | | Problem: Insufficient info when test fails because of screen size. Solution: Report the detected screen size. https://github.com/vim/vim/commit/0b5dc644465c549ac54fe3c4ad232dd692000d26
* | vim-patch:8.1.1860: map timeout test is flakyJan Edmund Lazo2019-08-16
|/ | | | | | Problem: Map timeout test is flaky. Solution: Add test to list of flaky tests. Increase timeout. https://github.com/vim/vim/commit/ea94c855163cf58a3389b5f3c54a0767c9e1be49
* vim-patch:8.1.1854: now another timer test is flaky #10791Jan Edmund Lazo2019-08-16
| | | | | Problem: Now another timer test is flaky. Solution: Add test to list of flaky tests. https://github.com/vim/vim/commit/973d5304a44c974e74e43c3790f8919b7d4193b4
* vim-patch:8.1.1852: timers test is flaky #10788Jan Edmund Lazo2019-08-16
| | | | | Problem: Timers test is flaky. Solution: Accept a larger count. Add test to list of flaky tests. https://github.com/vim/vim/commit/7e6feb9eeb095ec424430ff4332c77f70372ce62
* vim-patch:8.1.0456: running test hangs when the input file is being edited ↵Daniel Hahler2019-08-14
| | | | | | | (#10764) Problem: Running test hangs when the input file is being edited. Solution: Use a SwapExists autocommand to ignore editing the test script. https://github.com/vim/vim/commit/d8f27b30d6ec0bcfcb8f44c6201e36c003d1ce88
* vim-patch:8.1.1842: test listed as flaky should no longer be flakyDaniel Hahler2019-08-13
| | | | | | | Problem: Test listed as flaky should no longer be flaky. Solution: Remove Test_popup_and_window_resize from the list of flaky tests. (Daniel Hahler, close vim/vim#4807) https://github.com/vim/vim/commit/9570aacdb82c1eb5645d0fbc35bf9728d7334b23
* vim-patch:8.1.1738: testing lambda with timer is slow (#10590)Daniel Hahler2019-07-24
| | | | | | Problem: Testing lambda with timer is slow. Solution: Do not test timer accuracy, only that it works. (Daniel Hahler, closes vim/vim#4723) https://github.com/vim/vim/commit/9bc4dde45d45df732953491d0f2c3fd3b10a627e
* vim-patch:8.1.0533: screendump tests can be flakyJan Edmund Lazo2019-07-15
| | | | | | Problem: Screendump tests can be flaky. Solution: Add VerifyScreenDump to the pattern of flaky tests. https://github.com/vim/vim/commit/447f6ce8bd42fe3adbdf97eff9a38a9bfef9eeed
* vim-patch:8.1.0531: flaky tests often fail with a common error messageJan Edmund Lazo2019-07-15
| | | | | | Problem: Flaky tests often fail with a common error message. Solution: Add a pattern to match an error message indicating a flaky test. https://github.com/vim/vim/commit/dbc0d2163aa5e090d5a0c83aea448803ddbab664
* tests: oldtests: mark Test_cursorhold_insert as flaky [ci skip] (#10264)Daniel Hahler2019-06-19
| | | | | | | | | | | | | | | Fails often on CI (OSX), e.g.: ``` 1 FAILED: Found errors in Test_cursorhold_insert(): function RunTheTest[37]..Test_cursorhold_insert line 9: Expected 1 but got 0 ``` > Compiler: clang Xcode: xcode10.1 C The test could be adjusted to re-try the timer a few times, but I do not think it's really worth it currently, and that the test should be marked as flaky instead.
* vim-patch:8.1.0044: if a test function exists Vim this may go unnoticedJan Edmund Lazo2019-06-15
| | | | | | | | | Problem: If a test function exists Vim this may go unnoticed. Solution: Check for a test funtion quitting Vim. Fix tests that did exit Vim. https://github.com/vim/vim/commit/8903676d3d4c3fcb37d2a55c67370f30806b1626 Restore test_assert.vim to run Test_zz_quit_detected().
* vim-patch:8.1.1545: when the screen is to small there is no message about thatJan Edmund Lazo2019-06-15
| | | | | | | Problem: When the screen is to small there is no message about that. (Daniel Hahler) Solution: Do not use :cquit. (closes vim/vim#4534) https://github.com/vim/vim/commit/45aa07d3c126e887c614f8a4ebdb88aed673a9f1
* vim-patch:8.0.1689: no tests for xxdJan Edmund Lazo2019-06-11
| | | | | | Problem: No tests for xxd. Solution: Add a test. (Christian Brabandt) https://github.com/vim/vim/commit/29f9ed20b42e7badea6cfb82fb1fb8d71f33e282
* vim-patch:8.1.0529: flaky test sometimes fails in different waysDaniel Hahler2019-06-08
| | | | | | | Problem: Flaky test sometimes fails in different ways. Solution: When the second run gives a different error, try running the test again, up to five times. https://github.com/vim/vim/commit/f77af0e61339d553a0a41e3d19dd3fc89ba57fe8
* vim-patch:8.1.0696: when test_edit fails 'insertmode' may not be resetJan Edmund Lazo2019-01-06
| | | | | | | | | Problem: When test_edit fails 'insertmode' may not be reset and the next test may get stuck. (James McCoy) Solution: Always reset 'insertmode' after executing a test. Avoid that an InsertCharPre autocommand or a 'complete' function can change the state. (closes vim/vim#3768) https://github.com/vim/vim/commit/8ad16da7290190f55f88073d5586dfe133fddf45
* vim-patch:8.1.0299: misplaced commentJan Edmund Lazo2018-11-17
| | | | | | Problem: misplaced comment Solution: Remove comment https://github.com/vim/vim/commit/142ae736d984f4575c1c6ec1a4f679ae4ddf9413
* vim-patch:8.1.0298: window resize test sometimes fails on MacJan Edmund Lazo2018-11-17
| | | | | | Problem: Window resize test sometimes fails on Mac. Solution: Add Test_popup_and_window_resize() to flaky tests. https://github.com/vim/vim/commit/46fad2ef0bd5124f1be22c807214c243fb5611d8
* test/old: stub CanRunVimInTerminal()Justin M. Keyes2018-10-16
|
* vim-patch:8.0.1507: timer test is a bit flakyJan Edmund Lazo2018-08-05
| | | | | | Problem: Timer test is a bit flaky. Solution: Add it to the list of flaky tests. https://github.com/vim/vim/commit/bfbea567d89fdaa08ed987fd80daa53a6ce399d1
* vim-patch:8.0.0805: GUI test fails with gnome2Jan Edmund Lazo2018-07-24
| | | | | | Problem: GUI test fails with gnome2. Solution: Set $HOME to an existing directory. https://github.com/vim/vim/commit/d1ee0043c0360f6b504c0283edd2a844ef73a349
* vim-patch:8.0.0489: clipboard and "* register is not testedlonerover2018-05-20
| | | | | | Problem: Clipboard and "* register is not tested. Solution: Add a test for Mac and X11. (Kazunobu Kuriyama) https://github.com/vim/vim/commit/7dd4850698e37c3ed4a3c3b23f4cdbf1ae6542f8
* oldtests: newstyle: win: reset shell to cmd.exeJan Edmund Lazo2018-04-12
| | | | | | | | Unset $SHELL so that child nvim use cmd.exe as default shell. Unset $TERM so that child nvim don't segfault with negative exit code. sh/bash use TERM=cygwin by default if it is unset. mintty sets TERM to xterm.
* vim-patch:8.0.0417: test for the clipboard fails sometimes (#8174)KunMing Xie2018-03-25
| | | | | Problem: Test for the clipboard fails sometimes. Solution: Add it to the flaky tests. https://github.com/vim/vim/commit/0fbff646d5beb1f48c9be3d0ce0339be90fd49f5
* Merge #8001 from justinmk/vimpatchesJustin M. Keyes2018-02-12
|\
| * vim-patch:8.0.1302: still too many old style testsJustin M. Keyes2018-02-11
| | | | | | | | | | | | | | | | Problem: Still too many old style tests. Solution: Convert a few more tests to new style. (Yegappan Lakshmanan, closes vim/vim#2326) https://github.com/vim/vim/commit/209d3874c19d73b209e7d223cf05ea22e183f408