v1.3.0

Author: tbali0524

.cgtest.full.php

@@ -61,7 +61,7 @@
         'scala',
         // 'swift',
         // 'typescript',
-        // 'vb.net',
+        'vb.net',
     // Additional languages, unsupported on CodinGame:
         // 'cobol',
         // 'fortran',

.cgtest.php

@@ -61,7 +61,7 @@
         'scala',
         // 'swift',
         // 'typescript',
-        // 'vb.net',
+        'vb.net',
     // Additional languages, unsupported on CodinGame:
         // 'cobol',
         'fortran',

CHANGELOG.md

@@ -9,12 +9,26 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ### Added
 
-- `c#` support added.
+- Nothing yet.
+
+### Changed
+
+- Nothing yet.
+
+### Fixed
+
+- Nothing yet.
+
+## [v1.3.0](https://github.com/tbali0524/cgtest/releases/v1.3.0) - 2022-08-05
+
+### Added
+
+- `c#` and `vb.net` support added.
 - `'--run-only'` command-line argument added.
 - `'run-only'` global option added to config file format.
 - `'runOnlyPuzzles'` language-specific option added to config file format.
 - `'buildPath'` global option added to config file format.
-- _turn #0_ input files added for several optimization puzzles.
+- partial test cases (input files with _turn #0_ data) added for several optimization and multi-turn solo puzzles.
 
 ### Changed
 

README.md

@@ -8,7 +8,7 @@ A multi-language offline batch test runner for `CodinGame` (or other) solo I/O p
 
 __CGTest__ is a simple command-line tool to run tests in batch mode using your local dev and runtime environments. With a single command, you can run hundreds of tests for your code, even if written in __multiple languages__, for __multiple puzzles__ (or projects), and for __multiple test cases__ per puzzle.
 
-CGTest was successfully used for running `c`, `c#`, `c++`, `d`, `dart`, `f#`, `fortran`, `go`, `groovy`, `haskell`, `java`, `kotlin`, `lua`, `pascal`, `perl`, `php`, `python`, `ruby`, `rust` and `scala` tests both in Windows and in Linux; and additionally `bash` and `ocaml` in Linux. It should also work on almost any other computer system, including Mac.
+CGTest was successfully used for running `c`, `c#`, `c++`, `d`, `dart`, `f#`, `fortran`, `go`, `groovy`, `haskell`, `java`, `kotlin`, `lua`, `pascal`, `perl`, `php`, `python`, `ruby`, `rust`, `scala` and `vb.net` tests both in Windows and in Linux, and additionally `bash` and `ocaml` in Linux. It should also work on almost any other computer system, including Mac.
 
 The test runner works for any non-interactive code that reads from a standard input stream, and writes the result to the standard output stream. Using it for CodinGame puzzles is only one possible use case.
 
@@ -103,7 +103,7 @@ Some settings (but not all) can be also overriden via command-line arguments. If
     * By default, all source code is expected to be in the respective `languageName/` directory, with the same name as the beginning of the test case input data file name.
     * If using _per-puzzle_ directories for the test cases, you must set the per-language `'sourcePath'` setting to `''` in the config file.)
 * If not provided via command-line, list the puzzle names in the config file either in the global `'puzzles'` section, or in a per-language `'includePuzzles'` list. If you have solution for a puzzle in most (but not all) languages, you can list it in the global puzzles section, but add also add to the per-language `'excludePuzzles'` lists for languages that you lack the solution.  
-* You can also add a puzzle to a per-language `'runOnlyPuzzles'` list in the config file. These puzzles will be built and run, but the tests will always pass, without evaluating the test results.
+* You can also add a puzzle to a per-language `'runOnlyPuzzles'` list in the config file. These puzzles will be built and run, but the tests will always pass, without evaluating the test results. This is useful to run some _optimization_ and _multi-turn_ puzzles on CodinGame.
 * You can change the directory structure and the file naming conventions that `CGTest` is using out of the box. However, you will need to tweak the config file a bit to your liking. For more details, check out the comments in the sample config file.
 
 ### Important
@@ -125,21 +125,24 @@ ___SPOILER ALERT:___ In the repository, there are solution source code files in
     * This has references to ALL the test cases included in the CGTest repository.
     * Some puzzles are listed in the global `'puzzles'` section. These are the shortest and simplest puzzles, so they are especially well-suited if you want to solve some puzzles in __all the CG-supported languages__.
     * Other puzzles are listed in a per-language `'includePuzzles'` or `'runOnlyPuzzles'` section. Modify the language and comment out the puzzle names as needed.
-    * For most puzzles currently only a single test case is provided. That is OK for a simple smoke-test, but not to prove that your solution is correct.
+    * For most puzzles, currently only a single test case is provided. That is OK for a simple smoke-test, but not enough to prove that your solution is really correct.
 
 ## Restrictions
 
 * _CGTest_ supports only solo I/O puzzles. For any test case, the input must be a fixed file (so a given line of input cannot depend on the output previously provided by the code). This means that some solo and optim puzzles cannot be tested. Bot programming is also out of question.
+    * The `run-only` configuration can be used to run these puzzles based on _turn #0_ input data, however your code must be modified for offline use to avoid running out of input.
 
 * CGTest is a single thread application, so tests are running in sequence, which can be rather slow if you have lots of test cases. If you start CGTest multiple times concurrently, use separate configuration files, with different output directory settings.
 
 * CGTest does not use containers or any other environment separation when running your tests. If your code does silly things, like deleting files, then CGTest will NOT prevent it doing the damage.
 
+* Building `C#` or `VB.NET` source code generates lots of files in the `.tests/temp/bin` and `.tests/temp/obj` directories. CGTest does not delete these directories with the `--clean` command-line option.
+
 ## Known issues
 
 I don't have local dev environment for all the 27 languages Codingame supports. Therefore, some of the languages default settings are not properly set up. You need to create a section for these languages in the config file.
 
-* I could not yet set up to run the tester properly for: `vb.net`, `clojure`, `objective-c`, `swift`
+* I could not yet set up to run the tester properly for: `clojure`, `objective-c`, `swift`
 * `javascript` and `typescript` code is run by `node`, however the `readline()` function is missing. I don't know how to properly polyfill this locally.
 * Running `bash` script works in WSL or in Linux, but I ran into issues with vanilla Windows using a _'bash for Windows'_ package such as `MSYS2`.
 

cgtest.php

@@ -22,7 +22,7 @@
 // So I skipped using OOP, and - as code repetition is low - even functions.
 // --------------------------------------------------------------------
 // init counters, start global timer
-$version = 'v1.3.0-dev';
+$version = 'v1.3.0';
 $zeroLanguageStat = [
     'countLanguages' => 0,
     'countDirectories' => 0,
@@ -71,6 +71,9 @@
 // --------------------------------------------------------------------
 // default configuration
 $defaultConfigFileName = '.cgtest.php';
+$csprojExtension = '.csproj';
+$vbprojExtension = '.vbproj';
+$vbProjectName = 'vb_project';
 $defaultConfig = [
     'dry-run' => false,
     'run-only' => false,
@@ -114,10 +117,11 @@
         'sourceExtension' => '.cs',
         'codinGameVersion' => '.NET Core 3.1.201',
         'versionCommand' => 'dotnet --version',
-        'buildCommand' => 'dotnet publish %b%p.csproj -o %b --nologo --use-current-runtime --sc -v:q',
-        'runCommand' => (PHP_OS_FAMILY == 'Windows' ? '%b%p.exe' : '%b%p'),
+        'buildCommand' => 'dotnet publish %b%p' . $csprojExtension
+            . ' -o %b --nologo --use-current-runtime --sc -v:q',
+        'runCommand' => '%b%p' . (PHP_OS_FAMILY == 'Windows' ? '.exe' : ''),
         'cleanPatterns' => [
-            (PHP_OS_FAMILY == 'Windows' ? '%b%p.exe' : '%b%p'),
+            '%b%p' . (PHP_OS_FAMILY == 'Windows' ? '.exe' : ''),
             '%b%p.pdb',
         ],
     ],
@@ -363,9 +367,13 @@
         'sourceExtension' => '.vb',
         'codinGameVersion' => '.NET Core 3.1.201',
         'versionCommand' => 'dotnet --version',
-        'buildCommand' => '',
-        'runCommand' => 'dotnet run %s',
-        'cleanPatterns' => [],
+        'buildCommand' => 'dotnet publish %b' . $vbProjectName . $vbprojExtension
+            . ' -o %b --nologo --use-current-runtime --sc -v:q', // -v:q
+        'runCommand' => '%b' . $vbProjectName . (PHP_OS_FAMILY == 'Windows' ? '.exe' : ''),
+        'cleanPatterns' => [
+            '%b' . $vbProjectName . (PHP_OS_FAMILY == 'Windows' ? '.exe' : ''),
+            '%b' . $vbProjectName . '.pdb',
+        ],
     ],
     // unsupported on CodinGame
     // todo: check
@@ -417,7 +425,6 @@
 $languageNonEmptyStringConfigKeys = ['sourceExtension', 'runCommand'];
 $languageOptionalStringConfigKeys = ['sourcePath', 'codinGameVersion', 'versionCommand', 'buildCommand'];
 $languageArrayConfigKeys = ['excludePuzzles', 'includePuzzles', 'runOnlyPuzzles'];
-$csprojExtension = ".csproj";
 $csprojTemplate =
 "<Project Sdk=\"Microsoft.NET.Sdk\">
   <ItemGroup>
@@ -799,8 +806,8 @@
         }
     }
     // --------------------------------------------------------------------
-    // Special case for C#: delete Directory.build.props file
-    if (($language == 'c#') and $config['clean']) {
+    // Special case for C# and VB.NET: delete Directory.build.props file
+    if ((($language == 'c#') or ($language == 'vb.net')) and $config['clean']) {
         if (file_exists($csDirectoryBuildPropsFilename)) {
             $unlinkResult = unlink($csDirectoryBuildPropsFilename);
             if (!$unlinkResult) {
@@ -918,9 +925,13 @@
                 }
             }
             // --------------------------------------------------------------------
-            // Special case for C#
-            if (($language == 'c#') and !$config['dry-run']) {
-                $csprojFilename = $config['buildPath'] . $puzzleName . $csprojExtension;
+            // Special case for C# and VB.NET
+            if ((($language == 'c#') or ($language == 'vb.net')) and !$config['dry-run']) {
+                if ($language == 'c#') {
+                    $csprojFilename = $config['buildPath'] . $puzzleName . $csprojExtension;
+                } else {
+                    $csprojFilename = $config['buildPath'] . $vbProjectName . $vbprojExtension;
+                }
                 if (file_exists($csprojFilename)) {
                     $unlinkResult = unlink($csprojFilename);
                     if ($config['clean']) {