Re: CDFO: Raw Data and XML

New Message Reply About this list Date view Thread view Subject view Author view

From: John Halleck (John.Halleck_at_utah.edu)
Date: Tue Jan 16 2001 - 17:55:28 CET 

Received: (from mdom_at_localhost) by karto.ethz.ch (8.9.3/8.9.3/SuSE Linux 8.9.3-0.1) id RAA30433 for cavexml-outgoing; Tue, 16 Jan 2001 17:57:16 +0100
Received: from cor.oz.cc.utah.edu (nahaj_at_cor.oz.cc.utah.edu [155.99.2.2]) by karto.ethz.ch (8.9.3/8.9.3/SuSE Linux 8.9.3-0.1) with ESMTP id RAA30429 for <cavexml_at_cartography.ch>; Tue, 16 Jan 2001 17:57:15 +0100
Received: from localhost (nahaj_at_localhost) by cor.oz.cc.utah.edu (8.9.2/8.9.2) with ESMTP id JAA23454; Tue, 16 Jan 2001 09:55:28 -0700 (MST)
Date: Tue, 16 Jan 2001 09:55:28 -0700 (MST)
From: John Halleck <John.Halleck_at_utah.edu>
To: Ralph Hartley <hartley_at_aic.nrl.navy.mil>
cc: Devin Kouts <devinkouts_at_earthlink.net>, cavexml_at_cartography.ch
Subject: Re: CDFO: Raw Data and XML
In-Reply-To: <3A64610C.1040802_at_aic.nrl.navy.mil>
Message-ID: <Pine.GSO.4.05.10101160952530.11050-100000@cor.oz.cc.utah.edu>
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-cavexml_at_karto.baug.ethz.ch
Precedence: bulk

On Tue, 16 Jan 2001, Ralph Hartley wrote:

> [...]

> There is of course a down side to including the original in processed
> data. The files could grow exponentially. This can happen when each step
> in the process adds its own copy of everything that came before. You can

  It would seem to me that agreed tags and format beforehand would minimize
  this, since a step can use what is there, and only needs to put out
  what it has really added. (Which, for the adjustment and analysis
  step might actually be a lot.)

> end up with an astronomical number of copies of the same thing. Having a
> big disk drive doesn't help here, a billion gigabyte disk will still end
> up full. Having lots of capacity just hides the problem untill it is to
> late to fix it.
>
> Some restraint in USING the ability to include files is called for. A
> good place to start would be a rule like "never include the same data
> more than once in the same file".

  Amen.
 
> Ralph Hartley
>

New Message Reply About this list Date view Thread view Subject view Author view

This archive was generated by hypermail 2b30 : Wed Feb 14 2001 - 00:03:52 CET