advertisement

Weblog:   The Python comunity has too many deceptive XML benchmarks
Subject:   Wow.
Date:   2005-01-25 08:50:46
From:   AaronWatters
Response to: Wow.

Hmmm... maybe benchmarks of this ilk should go
through some sort of peer review before they are
widely publicized? Just a thought.
Full Threads Oldest First

Showing messages 1 through 1 of 1.

  • Wow.
    2005-01-25 15:29:35  effbot [Reply | View]

    Benchmarking individual components really isn't a black art. Just make sure you eliminate all irrelevant stuff from the measurements, use the best timing device you have access to, run the tests multiple times, and pick the best observed time (unless the object you're studying involves random elements). Make sure your math and your logic is sound; if A and B are large numbers, A+B doesn't equal max(A, B). If you're measuring really fast things, you need to be more careful. If you want prior art, study available tools (such as timeit). If anything I just said is news to you, don't do benchmarks. No need to be stupid. Being stupid only makes you look like a fool.

Showing messages 1 through 1 of 1.
-->