Difference between revisions of "Main Page/Endnote"

From phurvitz
Jump to: navigation, search
 
(→‎A perl script for creating a sed script to fix the term list)
Line 29: Line 29:
 
also creates a standardized term list
 
also creates a standardized term list
 
<pre>
 
<pre>
−
#! /usr/bin/perl -w
+
#! /usr/bin/perl -W
 +
use strict;
 
use warnings;
 
use warnings;
−
#local $/=undef;
 
  
−
# read the sed scripts to fix the endnote library
+
# construct sed scripts for fixing endnote
  
−
# open the xml library and read it all in
+
# open output files
−
open (LIBRARY, "<pmh_phd.xml") or die "cannot open";
+
open (SED, '>sed_nodots.sed');
−
my $lines = <LIBRARY>;
+
open (OUTTERM, '>pmh_phd_journals_term_fixed.txt');
−
close (LIBRARY);
+
# read input file
−
# remove the header and trailer stuff
+
open (INFILE, "<pmh_phd_journals_term.txt") or die "cannot open";
−
$lines =~ s/<XML><RECORDS>//;
+
while (my $record = <INFILE>) {
−
$lines =~ s/<\/RECORDS><\/XML>//;
+
    chomp $record;
−
$lines =~ s/\/RECORD>/\/RECORD>\n/g;
+
    # split into pieces with tabs
−
 
+
    my @list = split(/\t/, $record);
−
# make an array of records
+
    # how many substrings?
−
@linelist = split(/\n/, $lines);
+
    my $count = @list;
−
$linecount = @linelist;
+
    # extract the first 2 substrings
−
print "$linecount\n";
+
    my $ss1 = $list[0];
−
 
+
     my $ss2 = $list[1];
−
# array of lists
+
     # if 3 substrings
−
my @group = ();
+
     if ($count == 3) {
−
 
+
        # get the 3rd substring
−
# open and start reading the list of journal names
+
my $ss3 = $list[2];
−
open (SED, "<sed_nodots.sed") or die "cannot open sed_dots.sed";
+
# handle dots
−
$count = 0;
+
$ss3 =~ s/\./\\\./g;
−
while (<SED>) {
+
$ss2 =~ s/\./\\\./g;
−
     $count++;
+
        print SED "s|$ss3|$ss1|\n";
−
    print "$count\n";
+
        print SED "s|$ss2|$ss1|\n";
−
    $sedstr = $_;
+
# if neither substring has a dot
−
     chomp $sedstr;
+
if (($ss2 !~ m/\./) && ($ss3 !~ m/\./)) {
−
     @substr = split(/\|/, $sedstr);
+
    print OUTTERM "$ss1\t$ss3\t$ss2\n";
−
    $sub1 = $substr[1];
+
}
−
    $sub2 = $substr[2];
+
        # if the 2nd ss has a dot and the 3rd does not
−
    $sub2 =~ s/\&/\&amp\;/g;
+
if (($ss2 =~ m/\./) && ($ss3 !~ m/\./)) {
−
    $lines =~ s/<SECONDARY_TITLE>$sub1<\/SECONDARY_TITLE>/<SECONDARY_TITLE>$sub2<\/SECONDARY_TITLE>/g;
+
    print OUTTERM "$ss1\t$ss3\t$ss2\n";
−
}
+
}
−
close (SED);
+
        # if the 3nd ss has a dot and the 2rd does not
−
 
+
    if (($ss2 !~ m/\./) && ($ss3 =~ m/\./)) {
−
# an array of lines
+
    print OUTTERM "$ss1\t$ss2\t$ss3\n";
−
@linelist = split(/\n/, $lines);
+
}
−
 
+
        # if both ss have dots
−
# process....
+
    if (($ss2 =~ m/\./) && ($ss3 =~ m/\./)) {
−
$outfile = "xml_0.xml";
+
    print OUTTERM "$ss1\t$ss2\t$ss3\n";
−
open (OUT, ">$outfile");
+
}
−
$count = 0;
 
−
foreach $line (@linelist) {
 
−
    $count++;
 
−
    # substitute
 
−
    $line =~ s/<\/w+>/<\/foobar1>\n\n/;
 
−
    print OUT $line;
 
−
    $f = $count/100;
 
−
    $mod = $count%10;
 
−
    $r = (int($count/10))%10;
 
−
    if (($mod == 0) && ($r == 0)) {
 
−
      close (OUT);
 
−
      $outfile = join("\.", join("_", "xml", $f), "xml");
 
−
      open (OUT, ">$outfile");
 
 
     }
 
     }
 
}
 
}
−
close (OUT);
+
close INFILE;
−
 
+
close SED;
−
 
+
close OUTTERM;
 
</pre>
 
</pre>

Revision as of 08:28, 29 October 2007

Fixing abbreviated journal names

Some of my references had the full journal name and others had abbreviations. This causes problems when you need a bibliography in a specific format, e.g., with full names you will get the abbreviations for those that do not have full names in the reference; e.g., if you want abbreviations, EndNote will ignore the term lists for those that are stored with abbreviated names.

I got a copy of term lists from the University of Queensland.

To update the term list in Endnote

  1. Open the library.
  2. Click on Tools on the menu bar and choose Define Term Lists
  3. Highlight Journals
  4. Select all journals.
  5. Delete (right-click/Cut). Do not remove the term list altogehter; there does not seem to be a way to add the journals term list back with all the fields in EndNote 7, contrary to the documentation.
  6. Click on the Import List button.
  7. Select the text file to be imported and click on the Open button (I used the Medical, Biosciences, and Chemistry lists).

To fix the list (deprecated, as there is no standard for which abbreviation has the dots)

  1. Export the term list (click the Export List button). I saved this as pmh_phd_journals_term.txt.
  2. Separate the list into columns, one for the full title, and one each for the abbreviated titles. 
    cut -f1 pmh_phd_journals_term.txt > full.txt
    cut -f2 pmh_phd_journals_term.txt > abb1.txt
    cut -f3 pmh_phd_journals_term.txt  | sed "s/\./\\./g" > abb2.txt
  3. Join the columns back together with some sed to pre-format the sed scripts for the master edit process:

A perl script for creating a sed script to fix the term list

also creates a standardized term list 

#! /usr/bin/perl -W
use strict;
use warnings;

# construct sed scripts for fixing endnote

# open output files
open (SED, '>sed_nodots.sed');
open (OUTTERM, '>pmh_phd_journals_term_fixed.txt');
# read input file
open (INFILE, "<pmh_phd_journals_term.txt") or die "cannot open";
while (my $record = <INFILE>) {
    chomp $record;
    # split into pieces with tabs
    my @list = split(/\t/, $record);
    # how many substrings?
    my $count = @list;
    # extract the first 2 substrings
    my $ss1 = $list[0];
    my $ss2 = $list[1];
    # if 3 substrings
    if ($count == 3) {
        # get the 3rd substring
	my $ss3 = $list[2];
	# handle dots
	$ss3 =~ s/\./\\\./g;
	$ss2 =~ s/\./\\\./g;
        print SED "s|$ss3|$ss1|\n";
        print SED "s|$ss2|$ss1|\n";
	# if neither substring has a dot
	if (($ss2 !~ m/\./) && ($ss3 !~ m/\./)) {
	    print OUTTERM "$ss1\t$ss3\t$ss2\n";
	}
        # if the 2nd ss has a dot and the 3rd does not
	if (($ss2 =~ m/\./) && ($ss3 !~ m/\./)) {
	    print OUTTERM "$ss1\t$ss3\t$ss2\n";
	}
        # if the 3nd ss has a dot and the 2rd does not
    	if (($ss2 !~ m/\./) && ($ss3 =~ m/\./)) {
	    print OUTTERM "$ss1\t$ss2\t$ss3\n";
	}
        # if both ss have dots
    	if (($ss2 =~ m/\./) && ($ss3 =~ m/\./)) {
	    print OUTTERM "$ss1\t$ss2\t$ss3\n";
	}
    }
}
close INFILE;
close SED;
close OUTTERM;
Retrieved from "http://faculty.washington.edu/phurvitz/mediawiki/index.php?title=Main_Page/Endnote&oldid=1523"