Show HN: Flawd is mutation testing for the AI era

(fixture.dev)

4 points | by fohara 4 hours ago ago

5 comments

  • alxwrd 4 hours ago

    Would love to try this, but it appears the trial requests are broken

        Content-Security-Policy: The page’s settings blocked a script (script-src-elem) at https://challenges.cloudflare.com/turnstile/v0/api.js?render=explicit from being executed because it violates the following directive: “script-src 'self' 'sha256-SMalEXjN5ltC0WTMOtJTO7adqjVmsBbKVQMxVs4wkNM='” app.zp5tf3yd.js:1123:459
    
    
        >>> POST https://www.fixture.dev/api/eval/request
    
        <<< {"error":"turnstile_token is required","code":"VALIDATION_ERROR"}
    • fohara 4 hours ago

      Ouch, thanks for the heads up! Will have a fix up shortly.

      • fohara 2 hours ago

        Fixed. Thanks again for the report and sorry for the hassle!

  • devo_shn 4 hours ago

    Okay, this looks great! I have been struggling with mutation testing on a personal project built in Python. Just a few things: how does it generate mutants? Does it need specific testing libraries (like pytest) and then create mutants out of those tests? For the particular project, I created a small testing library as I felt pytest would be overkill, curious if it'll be able to help me too.

    • fohara 4 hours ago

      Thanks! It generates mutant by parsing the source code (via tree-sitter) and then using a collection of operators to make changes such as invert booleans, flip comparison operators, etc.

      It is built with certain testing libraries in mind, especially for defaults, but it is also extensible such that you should be able to get it working with your custom testing library. The `flawd init` command should provide some meaningful context, and I would be happy to lend a hand with config if you're up for sharing some more context. Feel free to contact me through the site or via email (in profile)