Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id 8FC0C431E64 for ; Wed, 1 Feb 2012 02:18:07 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=5 tests=[none] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2mxWAW4CcL41 for ; Wed, 1 Feb 2012 02:18:07 -0800 (PST) Received: from guru.guru-group.fi (guru-group.fi [87.108.86.66]) by olra.theworths.org (Postfix) with ESMTP id 06C03431FAF for ; Wed, 1 Feb 2012 02:18:07 -0800 (PST) Received: by guru.guru-group.fi (Postfix, from userid 501) id 6285F68055; Wed, 1 Feb 2012 12:18:08 +0200 (EET) From: Tomi Ollila To: Dmitry Kurochkin , Jameson Graef Rollins , notmuch@notmuchmail.org Subject: Re: [PATCH] test: make test_expect_equal_file() arguments flexible In-Reply-To: <87pqdync64.fsf@gmail.com> References: <1328080794-24670-1-git-send-email-dmitry.kurochkin@gmail.com> <87r4yfszx9.fsf@servo.finestructure.net> <87pqdync64.fsf@gmail.com> User-Agent: Notmuch/0.11+146~geb6dc33 (http://notmuchmail.org) Emacs/23.3.1 (x86_64-unknown-linux-gnu) X-Face: HhBM'cA~ MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Feb 2012 10:18:07 -0000 There are at least these options here 1) go through all ~100 places where test_expect_equal_file is used and fix the call order: quick look tells that the offending uses are in dump-restore, hooks, search-limiting and symbol-hiding. 2) enforce "expected" filename has some format *and* fix all current uses of it. Add testbed_error () function which yells loudly ane exits... 3) guess which is output and which is expected from args so that machine helps tester here (for both diff output & copied files)a 4) just copy compared files to some directory, those are named as basename of the original -- diff order still inconsistent. I'd just go with option 1 and fix new *violations* when stumble upon one. Tomi