Open Source Software Testing Tools

ebizzy is designed to generate a workload resembling common web application server workloads. It is highly threaded, has a large in-memory working set, and allocates and deallocates memory frequently.

This benchmark suite is intend as a tool for the research community. It consists of a set of open source, real world applications with non-trivial memory loads.

Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db.

KCachegrind visualizes traces generated by profiling, including a tree map and a call graph visualization of the calls happening. It's designed to be fast for very large programs like KDE applications.

Kieker is a framework for continuous monitoring and dynamic analysis of distributed software systems. Being designed for continuous operation, it induces only a low overhead. The TraceAnalysis tool allows to analyze and visualize trace information.

Tool for monitoring of OCI client applications [f.e.: TOAD/TOra, or any OCI-based fat client] interaction with Oracle Database. Monitors SQL statements and values passed/fetched between client application and RDBMS. Consists of simple and nice GUI [C#] and events handler [C++] with quite a lot of OCI hacking. Interface between handlers and tool's GUI is through tailing of XML "pipeline" files in $HOME/.ocimonitor directory. Tool is quite similar to Quest SQLMonitor, which is unable to trace values.

Framework for profiling & early performance testing of J2SE, thread based applications. Integrates into the Maven build-cycle. Closely integrates with YourKit profiler to produce automatic CPU profiling of you application.

Warning: Older projects may have to be compiled with -DDEBUG_NEW_CONFIG_HAVE_DEPRECATED Debug_New offers the possibility of debugging memoryleaks, not only (note the "not only"; that's just one of its functions) in a <report-memory-leaks-on-shutdown> kind of way, but implemented using memory-states. - Cross platform + Cross compiler support (only utilizes the preprocessor and template-voodoo-magic for c++) - Supports C and C++ - Supports gcc and g++ - Supports pthread and any posix platform - Multithreading is supported. - Easy to use and install (just include the header and link the source). - Easily debug memory-leaks. - Easily debug dangling pointers. - Easily debug deallocation method correctness. - Easily debug array index errors (when writing past the end). - Easily profile memory usage and track down memory hawks. - Click-And-Goto-Source support for Visual Studio. - Integrated compatibility for new, new[], delete, delete[], malloc, calloc, realloc, free

Simple monitoring utility to help optimizing a (MySQL) database server. Run the utility for a time to record queries on the database. Generate reports while the utility is running or afterwards. Reports are available as text or excel-sheets.

A simple commandline tool that displays the timestamp in seconds, milliseconds and microseconds. Detailed information: http://sourceforge.net/apps/trac/sabali-timex/

Jensor is a light-weight, low-overhead Java Profiler built using Java BCI. Jensor provides innovative analysis modules like JVM Replay, Pattern Analysis and Tagging Engine for technical as well as business analysis based on the same underlying data.

ATrace is a tracing tool uses the ptrace interface. ATrace allows tuning and troubleshooting of applications without modification of the source or object code and can be parameterized via config files and logs the addresses of executed instructions.

BeCover is a Java code coverage tool based on source-code analysis. The main goal is to keep it small and fast, so using it as a plugin in the common IDE's can be achieved.

This project born a few years ago when I encountered a fatal bug on a production environment, unfortunately not replicable on my development machine. I spent many time finding a solution, using also freeware and commercial third-party tools and libraries, but none helped me because the bug crashed the process, and no of the above tools could be able to catch the exception before the process dying. Also, it was not possible to install a development environment onto the production machines, so the only solution was to develop a debugger which didn't need any user/developer interaction. I used many open source resources, then I decided to make the Bug Finder an open source project. It is built over a pluggable architecture to support other languages different from Borland Delphi (the one I used to develop my faulting application and the Bug Finder too). Here is the article http://www.codeproject.com/Articles/602794/Bug-Finder-a-real-Win32-extensible-passive-debugge .

COMPAS J2EE is a non-intrusive performance instrumentation and monitoring toolkit for J2EE. It uses adaptive monitoring to automatically adjust the target coverage. COMPAS is completely portable across J2EE application servers and OSs.

This project is now maintained at GitHub: https://github.com/DigitalInBlue/Celero Celero is a cross-platform open source C++ benchmarking library. Written with an API similar to Google Test, Celero utilizes C++11 features, offers tested benchmarking capabilities with microsecond precision, baselining, fixtures, and easy test setup. Use the baseline feature to measure/benchmark algorithm performance against a known case to more accurately rate performance of solutions.

Centurion is a very simple and powerful tool for benchmarking your code's efficiency. How to use it: var my_centurion = new centurion(); Centurion API namespaces: .benchmark - Do a benchmark .status - Check status of benchamark. To see the full API under the namespaces do: "console.log(my_centurion);" Enjoy!

ClassReach is a utility to identify unused Java classes and methods. Once identified, such things can be removed from the code, hopefully simplifying the system.

DbgProfiler provides an easy mechanism for profiling certain hotspots of an application by just adding a few macros to the C++ source code. A hierarchy of the callers and callees is generated automatically and allows a detailed analysis of the results.

Dynamic Probe Class Library (DPCL) is an object based C++ class library that provides the necessary infrastructure to allow tool developers and sophisticated tool users to build parallel and serial tools through technology called dynamic instrumentation.

EfficiencyGuardian extracts callgrind efficiency measures from individual CppUnit test cases to detect efficiency regresion. It includes a data mining web tool to browse historic results and TestFarm integration for unattended execution on commit.

Foo Test is a small, fast C-function unit testing project. It is capable of both benchmarking and validating C-functions while writing most of the test code through an easy perl script, and all the developer needed code can be added to a single file.

An Extensible memory leakage detection system which can be turn on/off just including or not a C header

Glassbox is an automated troubleshooting and monitoring agent for Java apps that diagnoses common problems with one-click. Drop in a .war file from http://www.glassbox.com and find out what's wrong with your existing web apps, without any code chang

Generic data visualizer tool to display output of command line data sources.