Duke Libraries

Ask us now

Endeca/Catalog Data Updates (Release Notes)

The Catalog (Endeca) data is refreshed continuously, with enhancements made on a frequent basis to provide more accurate and/or more useful data. The following list of data enhancements and additions to the project reflect changes made to the Endeca (catalog) system since that portion of the interface went live in the Fall of 2008.
  • April 2009
    1. Added "EAD ID" Endeca field for processing finding aids.
    2. Changed Primary URL for 'Finding aids' to NOT be assigned to the Online facet.
    3. Added processing for 856 Primary URL from the DUK60 holdings.
    4. Added 866 subfield z to the holdings processing.  Added de-duplication of '866 $$a', '866 $$z' and '852 $$z'.
    5. Added a check for serial items with no holdings and no Primary URL. If found it adds 866HoldingsNote||"altLibrary"|"altLocation"||Ask at Circulation Desk.
    6. Records coded with the ANA/ITM LKR fields were displaying all child records of the parent.  I added a sub-routine to remove the items that did not match the items enueration, when the linker has issue, volume, and year information coded.
    7. Changed the adding of 590 field for holdings to only happen with non-serial items and added de-duplication against the item notes.
    8. For donor notes; any 590 field that has "gift of" in the first 17 characters of the notes field is changed to a 500 field so it can get indexed.
    9. Added sequence numbers to the 520, 6xx and ISBN/ISSN numbers to organize the repeating fields.
    10. Change Journal section criteria.
  • Feb 2009
    1. Changed Item and holdings processing for records with no or unlinked items.   This was producing phantom items if there was a holdings rec and no item matching it.   Endeca has to have items for records and the scripts were creating dummy items with an "Available" status for any that did not.  This works good for strict Internet record since the Endeca interface is set to display the records without those items.  The major problem with changing this is distinguishing the difference between "real" and "phantom" items and records.
      1. Removed item process status(IPS) LO, EX, NA OS from the suppressed items list.
      2. Creates a call number to 830 $$a file and removes duplicates.  This file is used later.
      3. Changed the holdings to item match-up from "If no match create dummy item" to "If no match and no item and no suppressed items create dummy item"
      4. If 500 field has "TEMPORARY RECORD" and no items, the bib record is suppressed.
      5. Status "Ask at Reference Desk" assigned for items in collection code PK3.
      6. Items with no call number receive alternative processing for the item status. 
        • News papers and periodicals are "Available".
        • Microform and items with temp barcodes are "Ask at Circulation Desk"
        • The collection is checked for default status. (see note)
        • "Available - Library Use Only" is assigned when needed.
        • All others are assigned "Ask at Circulation Desk"
      7. Non-Internet dummy items and items with temp barcodes receive alternative processing for the item status.
        • Maps are "Available"
        • The collection is checked for default status. (see note)
        • The call number is compared to the "call number to 830" file.  If it finds a match its status is "Available" and a Series Statement is added. (known issue: UN docs call numbers don't work)
        • All others are assigned "Ask at Circulation Desk"
      8. If an item has a final status of "Ask at Circulation Desk" and the bib record has a primary URL it is changed into an internet item.
      • NOTE  The collection code is used for the default status.  If not listed the default status is "Ask at Circulation Desk".
        • Default status is Available:  FRDD, FRDJI, FRDJS, FRDN, FRDP, FRDPC, FRDPE, FRDPF, FRDPH, FRDPI, FRDPJ, FRDPL, FRDPM, FRDPN, FRDPR, FRDR, FRDRI, FRDX, FRDXI, LSSCO, LUNCI, LUNCL, MAV, MAVRF, MCNEW, MENGL, MEPH, MHCIR, MHFOL, MHNEW, MHREF, MHWEL, MINDX, MJNL, MJNLA, MRES, MRF1, MRF10, MRF11, MRF12, MRF13, MRF14, MRF15, MRF16, MRF17, MRF18, MRF19, MRF1A, MRF2, MRF20, MRF21, MRF22, MRF23, MRF24, MRF25, MRF26, MRF27, MRF28, MRF29, MRF2A, MRF3, MRF4, MRF5, MRF6, MRF7, MRF8, MRF9, MRFCH, MSTKI, MSTPI, MTHES, PAGR, PAP, PAPI, PBP , PBPI, PBR, PBRC, PBRR, PCP, PCPI, PCRC, PCRI, PDP, PDPI, PDPU, PDR, PDRC, PDRF, PDRQ, PDRR, PDY, PGP, PGPI, PKEN, PKEP, PKEPI, PKN, PKNU, PKP, PKPI, PKR5, PKR6, PKV8, PLMPI, PLN, PLP, PLPI, PLV8, PLVL,PMP, PMPI, PN, PNB, PRNU, PSBP, PSCP, PSDP, PSKEP, PSKP, PSLP, PSMP, PSV2P, PSV3P, PSVP, PSZP, PV2P, PV2PI, PV3P, PV3PI, PVP, PVPI, PZP, PZPI
        • Default status is Not Available:  FRDC, HAV, HGEN, HPER, HPFH, HREF, HRES, HSR, MDISP, MMKPB, MMULT, MNCCT, MSYS, MTECH, POA, POAQ, POAT, POATI, POB, POBF, POBP, POBQ, POC, POCP, PODA, PODP, PODU, POK, POKF, POKFF, POKP, POKQ, POL, POLF, POLP, POM, POMP, POR, PORB, PORB2, PORDP, PORMS, POV, POV2, POV2P, POV2Q, POV2T, POV3P, POVP, POZP
    2. Updated scripts to ignore YBP numbers in the 035 field and enhanced the processing for oclc numbers that are the primary rollup number.
    3. Added the 830t field and processing.  The scripts should have had the 830 split into two fields,  the 830 for display and 830t for title indexing and did not.
    4. Records with enhanced content from Library of Congress were showing as an internet resource because there is no item and an 856.  It has an entry like "85641 L $$3Table of contents only$$uhttp://www.loc.gov/catdir/toc/ecip0611/2006011352.html"  The bib_seq_process script was only using "is there a 856" logic.  This has been updated to change the LOC enhanced content to secondary URLs and change RBMSCL finding aid URLs from secondary to primary URLs.

    5. Changed item type facet for online items to include any record with a primary URL.
    6. All URLs are changed to go through the proxy.
    7. Added item type facets from 942 for score.
    8. The AV item type was not used because it is to ambiguous.  It now checks the 538 and changes the item type accordingly.  (538 VHS = item type VIDEO)
    9. Government Documents that should been using the shipping list number as a rollup number were dropping the rollup number.  These documents were not showing in endeca.  The shipping number has been fixed and is producing a rollup number now.

    10. The 590 field was added to the notes de-duplication process.
  • Nov 2008
    1. Added processing for temporary locations.
    2. Add item type facets from 942 for Ebook, Audiobook and streaming video.
    3. Add item type facets from 655 for streaming video.
    4. Added 028  Publisher Number
    5. Added 'On Hold' and updated 'In Transit' statuses.
    6. Added item status '02' to show 'Available - Library Use Only'
    7. Updated notes fields to remove duplicates.
  • Oct 2008
    1. Removed periodical facet from newspaper records.
    2. Add status 'Ask at Circulation Desk' for LC re-class issues.
  • Sep 2008
    1. Added processing of 852 $$z to add the holdings notes to the 590 field so the donor book plates would show.
    2. Removed 245 $$h from title sort.
    3. Corrected item status '03' and '08' to show 'Available - Library Use Only'
    4. Added bib call number to processing for records that don't have item call numbers. 
    5. Changed removal of the '/' in the 245 to only remove the trailing '/'.
  • Aug 2008
    1. Added short title field to help with short journal titles.
    2. Added location 'Online' to DUKIR records missing the location.
    3. Improved holdings logic.
  • July 2008
    1. Changed location of aleph to endeca script from running at trln to running on judge.
    2. Corrected looping issue that was cutting off the last record of each run.  This was creating the need to run the full extracts more frequently.
    3. Changed serial type to use the leader, 852 $$D or 942 $$a then process them after all were read.  This was changed to an 'if any' logic  to account for inconsistencies.
    4. Changed the holdings to read and saved so it could be processed using item data after the items were read.
    5. Corrected the pipes for holding and items that had unexpected null values.
 

follow us on Twitter follow us on Facebook follow us on YouTube follow us on Flickr follow us on Pinterest follow our blogs and feeds

Contact Us919-660-5870
(Perkins Circulation Desk)

Home | Libraries | Ask Us Now | Catalog | Hours | Library Web Site Search | Site Index

Mobile Library Home (content for handheld devices such as cellphones)

Creative Commons License

Unless otherwise specified on this page, this work is licensed under a
Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.


Last modified December 17, 2009 5:09:19 PM EST