What's the best way to view/analyse/filter huge traces/logfiles?

Posted by oliver on Stack Overflow See other posts from Stack Overflow or by oliver
Published on 2010-03-18T15:04:56Z Indexed on 2010/03/18 15:11 UTC
Read the original article Hit count: 353

Filed under:

testing

|

analysis

this seems to be a reoccurring issue: we receive a bug report for our software and with it tons of traces or logfiles.
since finding errors is much easier when having a visualization of the log messages/events over time it is convenient to use a tool that can display the progression of events in a graph etc. (e.g. wireshark (http://www.wireshark.org) for analyzing network traffic)

what tool do you use for such a purpose?

the problem with most tools i used so far is that they mercilessly break down when you feed them huge data traces (> 1GB) so some criteria for such a tool would be:

can deal with huge input files (> 1 GB)
is really fast (so you don't have to get coffee while a file is loading)
has some sort of filtering mechanism

© Stack Overflow or respective owner

Related posts about testing

Automated unit testing, integration testing or acceptance testing

as seen on Programmers - Search for 'Programmers'
TDD and unit testing seems to be the big rave at the moment. But it is really that useful compared to other forms of automated testing? Intuitively I would guess that automated integration testing is way more useful than unit testing. In my experience the most bugs seems to be in the interaction… >>> More
Modifying a HTML page to fix several "bugs" add a function to next/previous on a option dropdown

as seen on Stack Overflow - Search for 'Stack Overflow'
SOF, I've got a few problems plaguing me at the moment and am wondering if anyone could assist me with them. I'm trying to get Next Class | Previous Class to act as buttons so that when Next Class is clicked it will go to the next item in the dropdown list and for previous it would go to back one… >>> More
Automation testing tool for Regression testing of desktop application

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi I am working on a desktop application which uses Infragistic grids. We need to automate the regression tests for same. QTP alone does not support this, we need to buy new plug in for same which my company is not very much interested in. Do we have any open source tool for automating regression… >>> More
Oracle Functional Testing Suite Advanced Pack for Oracle EBS Now Available

as seen on Oracle Blogs - Search for 'Oracle Blogs'
There’s new news about automated testing of E-Business Suite using the Oracle Application Testing Suite, a.k.a, “OATS”. E-Business Suite Development is pleased to announce the availability of the new Oracle Functional Testing Suite Advanced Pack for Oracle E-Business Suite. The new pack, available… >>> More
Do You Know How OUM defines the four, basic types of business system testing performed on a project? Why not test your knowledge?

as seen on Oracle Blogs - Search for 'Oracle Blogs'
Testing is perhaps the most important process in the Oracle® Unified Method (OUM). That makes it all the more important for practitioners to have a common understanding of the various types of functional testing referenced in the method, and to use the proper terminology when communicating with each… >>> More

Related posts about analysis

Visual Studio 2013 Static Code Analysis in depth: What? When and How?

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
In this post I'll illustrate in details the following points What is static code analysis? When to use? Supported platforms Supported Visual Studio versions How to use Run Code Analysis Manually Run Code Analysis Automatically Run Code Analysis while check-in source… >>> More
Using Analysis Services Processing Task & Analysis Services Execute DDL Task in SSIS

as seen on SQL Server Performance - Search for 'SQL Server Performance'
SQL Server Integration Services (SSIS) is a Business Intelligence tool which can be used by database developers or administrators to perform Extract, Transform & Load (ETL) operations. In my previous article Using WMI Data Reader and WMI Event Watcher ... [Read Full Article] >>> More
Should static analysis warnings fail the CI build?

as seen on Stack Overflow - Search for 'Stack Overflow'
Our team is investigating various options for static analysis in our project, and have mixed opinions about whether we want our Continuous Integration build to fail because of warnings from static analysis. The argument against failing the build is that there are often exceptions to the rules, and… >>> More
Introduction to Security in Analysis Services

as seen on Internet.com - Search for 'Internet.com'
Join BI Architect Bill Pearson in this introduction to Security in Analysis Services 2008. Here we explore security concepts and implementation, and look forward to hands-on practice with security in other articles of this subseries. >>> More
Using the Static Code Analysis feature of Visual Studio (Premium/Ultimate) to find memory leakage problems

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Memory for managed code is handled by the garbage collector, but if you use any kind of unmanaged code, like native resources of any kind, open files, streams and window handles, your application may leak memory if these are not properly handled. To handle such resources the classes that own these… >>> More