String replace in big files

Aegidius · 2013-04-13 06:37:55

Hello

I have a big text file and I have to replace the tab space with the ; character. I cannot do it with gedit cause it crashes.

How can I do?

Thank you

Egidio

PS: this is the file in question.

Last edited by Aegidius (2013-04-13 06:38:39)

tomk · 2013-04-13 07:05:42

Use sed.

Aegidius · 2013-04-13 07:19:01

I already tried with sed but I can't replace the tab space.

jasonwryan · 2013-04-13 07:22:16

http://stackoverflow.com/questions/3509 … rated-file

Moving to Scripting...

Aegidius · 2013-04-13 09:25:01

Thank you

I solved all the problems except for a thing.

I'm trying to use the PHP fgetcsv function. The new input csv has ; for delimiter character and \ for escape character.
When I call the function with

fgetcsv($inputFile, 0, ';', '"', '\\')

the script divides this line

978881159779;AL MERCATO CON JOANNE HARRIS. NUOVE RICETTE DALLA CUCINA DI ÇCHOCOLATÈ;F;GARZANTI LIBRI;;EDIZIONI SPECIALI;0;29,5;HARRIS JOANNE\; WARDE FRAN;00/00/00;;08/11/2007;;BA;;0;00/00/00;0;0;0;0;;n;9;MESSAGGERIE;;0;0;00/00/00;00/00/00;15/11/2010;00/00/00;0;;00/00/00;00/00/00;0;250;;1;960;200;252;20;0;C;;454690;Trd.GRANDI L.\13Fmt.8\13Ill.ILL., RIL.\13Dis.C\13;E;;

into this array

Array
(
    [0] => 978881159779
    [1] => AL MERCATO CON JOANNE HARRIS. NUOVE RICETTE DALLA CUCINA DI ÇCHOCOLATÈ
    [2] => F
    [3] => GARZANTI LIBRI
    [4] => 
    [5] => EDIZIONI SPECIALI
    [6] => 0
    [7] => 29,5
    [8] => HARRIS JOANNE\
    [9] =>  WARDE FRAN
    [10] => 00/00/00
    [11] => 
    [12] => 08/11/2007
    [13] => 
    [14] => BA
    [15] => 
    [16] => 0
    [17] => 00/00/00
    [18] => 0
    [19] => 0
    [20] => 0
    [21] => 0
    [22] => 
    [23] => n
    [24] => 9
    [25] => MESSAGGERIE
    [26] => 
    [27] => 0
    [28] => 0
    [29] => 00/00/00
    [30] => 00/00/00
    [31] => 15/11/2010
    [32] => 00/00/00
    [33] => 0
    [34] => 
    [35] => 00/00/00
    [36] => 00/00/00
    [37] => 0
    [38] => 250
    [39] => 
    [40] => 1
    [41] => 960
    [42] => 200
    [43] => 252
    [44] => 20
    [45] => 0
    [46] => C
    [47] => 
    [48] => 454690
    [49] => Trd.GRANDI L.\13Fmt.8\13Ill.ILL., RIL.\13Dis.C\13
    [50] => E
    [51] => 
    [52] => 
)

So it considers the ; in \; as a separator and does not skip it. Is that a PHP bug?

Thank you for the help

Egidio

Last edited by Aegidius (2013-04-13 09:29:34)

Trilby · 2013-04-13 11:05:42

Why can't you use sed? This is exactly the type of task it is for. tr might be an option to.

sed -i 's/\t/;/g' files

tr '\t' ';' < infile > outfile

Last edited by Trilby (2013-04-13 11:07:15)

Aegidius · 2013-04-13 11:21:34

Trilby thanks for the answer

Actually I just solved that problem. Now I have another problem, posted 2 messages above.

Egidio

Aegidius · 2013-04-14 09:25:03

Last edited by Aegidius (2013-04-14 09:25:24)

Procyon · 2013-04-14 09:51:42

Is it an option to use an in between string? sed -i 's/\\;/%escsemi%/g' files and then change it back later?

Aegidius · 2013-04-14 10:28:50

Procyon thank you

I did it in that way, but I'm still curious why the escape character does not work ?¿?¿?¿

ewaller · 2013-04-14 12:20:16

Aegidius wrote:

Please do not "bump". It is against our policy
Draw attention by posting more information -- what you have learned, what you have read, what you have tried.

Thanks

Aegidius · 2013-04-14 12:22:40

I'm sorry

Arch Linux

#1 2013-04-13 06:37:55

String replace in big files

#2 2013-04-13 07:05:42

Re: String replace in big files

#3 2013-04-13 07:19:01

Re: String replace in big files

#4 2013-04-13 07:22:16

Re: String replace in big files

#5 2013-04-13 09:25:01

Re: String replace in big files

#6 2013-04-13 11:05:42

Re: String replace in big files

#7 2013-04-13 11:21:34

Re: String replace in big files

#8 2013-04-14 09:25:03

Re: String replace in big files

#9 2013-04-14 09:51:42

Re: String replace in big files

#10 2013-04-14 10:28:50

Re: String replace in big files

#11 2013-04-14 12:20:16

Re: String replace in big files

#12 2013-04-14 12:22:40

Re: String replace in big files

Board footer