PERL for search and replace

March 16, 2006

You can use PERL as a stream editor to replace strings in one or more files in a directory like this:

perl -pi.orig -e ‘s/bgcolor=#ffffff/bgcolor=#000000/i’ *.html

The above replaces the color white with black in all html files in this directory and saves the original files with .orig extension.


Apache Tweaks

March 15, 2006

Avoid truncated filenames in log by editing httpd.conf:
IndexOptions FancyIndexing NameWidth=*

Here is a handy Perl script to compress all Apache logs automatically called LogFlume.

Serve an additional site under same DocumentRoot:

Add new Virtual Host:

DocumentRoot /home/www/htdocs #same as other site
RewriteEngine On
RewriteRule ^/$ /home/www/htdocs/newsite/index.html
RewriteRule ^/index.html$ /home/www/htdocs/newsite/index.html

Restore single MySQL table from large DB dump

March 15, 2006

Here’s how to restore one or more tables from a full database archive. It assumes you used mysqldump to save the database and stored it in a gz file. First create the file

#!/usr/bin/perl -wn
BEGIN { $table = shift @ARGV }
print if /^create table $table\b/io .. /^create table (?!$table)\b/io;

Then do the following to restore the table:

zcat /path/ | extract-table Mytable> ~/Mytable.dump
mysql  mydatabase -e "drop table Mytable"
mysql mydatabase

Monitoring Web Traffic in Real Time with httptop

March 15, 2006

See who’s hitting your web server the hardest up to the second with httptop a Perl script from O’Reilley at

PERL One Liners

March 15, 2006

perl my_file

# run debugger “stand-alone”
perl -d -e 42

# run program, but with warnings
perl -w my_file

# run program under debugger
perl -d my_file

# just check syntax, with warnings
perl -wc my_file

# useful at end of “find foo -print”
perl -nle unlink

# simplest one-liner program
perl -e ‘print “hello world!\n”‘

# add first and penultimate columns
perl -lane ‘print $F[0] + $F[-2]’

# just lines 15 to 17
perl -ne ‘print if 15 .. 17’ *.pod

# in-place edit of *.c files changing all foo to bar
perl -p -i.bak -e ‘s/\bfoo\b/bar/g’ *.c

# command-line that prints the first 50 lines (cheaply)
perl -pe ‘exit if $. > 50’ f1 f2 f3 …

# delete first 10 lines
perl -i.old -ne ‘print unless 1 .. 10’ foo.txt

# change all the isolated oldvar occurrences to newvar
perl -i.old -pe ‘s{\boldvar\b}{newvar}g’ *.[chy]

# command-line that reverses the whole file by lines
perl -e ‘print reverse ‘ file1 file2 file3 ….

# find palindromes
perl -lne ‘print if $_ eq reverse’ /usr/dict/words

# command-line that reverse all the bytes in a file
perl -0777e ‘print scalar reverse ‘ f1 f2 f3 …

# command-line that reverses the whole file by paragraphs
perl -00 -e ‘print reverse ‘ file1 file2 file3 ….

# increment all numbers found in these files
perl i.tiny -pe ‘s/(\d+)/ 1 + $1 /ge’ file1 file2 ….

# command-line that shows each line with its characters backwards
perl -nle ‘print scalar reverse $_’ file1 file2 file3 ….

# delete all but lines beween START and END
perl -i.old -ne ‘print unless /^START$/ .. /^END$/’ foo.txt

# binary edit (careful!)
perl -i.bak -pe ‘s/Mozilla/Slopoke/g’ /usr/local/bin/netscape

# look for dup words
perl -0777 -ne ‘print “$.: doubled $_\n” while /\b(\w+)\b\s+\b\1\b/gi’

# command-line that prints the last 50 lines (expensively)
perl -e ‘lines = ; print @@lines[ $#lines .. $#lines-50’ f1 f2 f3 …