Robin H. Johnson [Tue, 12 Aug 2014 18:46:57 +0000 (11:46 -0700)]
Apply patch from
c6520c9179834915910d8c294b3078b3f5114e17:marc_export_custom to marc_export_custom_ms.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Tue, 12 Aug 2014 18:46:18 +0000 (11:46 -0700)]
Apply patch from
0cb635749fd8aca004879850b2b9f456e9921b91:marc_export_custom to marc_export_custom_ms.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Tue, 12 Aug 2014 18:45:12 +0000 (11:45 -0700)]
Apply patch
dd134fdd181664e285e935371c92e03c9a2c065b from marc_export_custom to marc_export_custom_ms.
Mark Bucholtz [Tue, 12 Aug 2014 14:19:04 +0000 (07:19 -0700)]
add marc export scripts for cotr
Robin H. Johnson [Sat, 2 Aug 2014 17:15:21 +0000 (10:15 -0700)]
Postfix sendmail binary needs an extra option.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Sat, 2 Aug 2014 17:11:28 +0000 (10:11 -0700)]
Fix syntax.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Sat, 2 Aug 2014 17:09:03 +0000 (10:09 -0700)]
More PerlOPT.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Sat, 2 Aug 2014 17:07:19 +0000 (10:07 -0700)]
Document scripts better, and squelch output.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Sat, 2 Aug 2014 17:02:27 +0000 (10:02 -0700)]
Fix grep fail.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Sat, 2 Aug 2014 17:02:18 +0000 (10:02 -0700)]
Make it possible to get a quiet perl.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Jeff Davis [Tue, 29 Jul 2014 19:29:00 +0000 (12:29 -0700)]
integrity-checker.pl: strip newline from hash-file input
Jeff Davis [Tue, 29 Jul 2014 19:00:07 +0000 (12:00 -0700)]
integrity-checker.pl: fix command-line options for printing git hashes
Liam Whalen [Sun, 20 Jul 2014 00:29:58 +0000 (17:29 -0700)]
Fetch from the REMOTE
Currently, you need to manually keep your git repo fetched before any
changes exist to be deployed.
This commit adds a git fetch to pull any changes before deploying.
Signed-off-by: Liam Whalen <liam.whalen@bc.libraries.coop>
Liam Whalen [Sun, 20 Jul 2014 00:18:17 +0000 (17:18 -0700)]
Create relative paths for local file storage
Currently, when deploying, the local files used to deploy to the server
are stored in the same directory. When there are files that have the
same name, the last file to be deployed is the only one present in the
directory because it overwrites the previous files with the same name.
This commit creates a temporary directory with the relative path of the
filename appended to the end of the temporary directory.
Signed-off-by: Liam Whalen <liam.whalen@bc.libraries.coop>
Jeff Davis [Wed, 16 Jul 2014 19:40:48 +0000 (12:40 -0700)]
Merge branch 'eg26'
Jeff Davis [Wed, 16 Jul 2014 18:52:07 +0000 (11:52 -0700)]
RT21793: BTR outlook profile - exclude On Order records
Jeff Davis [Fri, 27 Jun 2014 00:53:29 +0000 (17:53 -0700)]
install-drone.sh: it is important to correctly copy the specially built Perl libs to their proper home
Jeff Davis [Wed, 25 Jun 2014 23:27:13 +0000 (16:27 -0700)]
install-drone.sh: update for EG2.6
Jeff Davis [Mon, 23 Jun 2014 22:49:56 +0000 (15:49 -0700)]
Deploy latest EG branch (upgrade/eg26/rc1-tpac)
Jeff Davis [Fri, 6 Jun 2014 22:44:14 +0000 (15:44 -0700)]
install-eg.sh: hack to use already-localized fm_IDL.xml (see RT19953)
Jeff Davis [Fri, 6 Jun 2014 22:43:13 +0000 (15:43 -0700)]
install-eg.sh: install Sitka's version of 2.6.1 from git
Jeff Davis [Fri, 6 Jun 2014 22:39:35 +0000 (15:39 -0700)]
Revert "update install-eg.sh to install EG 2.6 beta1 from tarball"
This reverts commit
6f940e4f50cb3d1b4420cc28d7ae5838f0404691.
Jeff Davis [Tue, 4 Mar 2014 21:36:46 +0000 (13:36 -0800)]
install-eg.sh: fix incorrect test for whether files exist
Robin H. Johnson [Wed, 9 Apr 2014 18:11:06 +0000 (11:11 -0700)]
Drop BKCT in config
Jeff Davis [Tue, 4 Mar 2014 21:36:46 +0000 (13:36 -0800)]
install-eg.sh: fix incorrect test for whether files exist
Jeff Davis [Thu, 27 Feb 2014 23:14:46 +0000 (15:14 -0800)]
update install-eg.sh to install EG 2.6 beta1 from tarball
Jeff Davis [Thu, 27 Feb 2014 23:04:18 +0000 (15:04 -0800)]
update install-osrf.sh to install OSRF 2.3 from git (for EG 2.6)
Robin H. Johnson [Fri, 21 Feb 2014 00:01:26 +0000 (16:01 -0800)]
RT18577: BCRE outlook profile.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Jeff Davis [Thu, 20 Feb 2014 19:47:28 +0000 (11:47 -0800)]
tweaks to install-eg.sh
Liam Whalen [Fri, 10 Jan 2014 23:23:46 +0000 (15:23 -0800)]
(sitka) [RT18017] Fixed sync using local instead of remote branch
Using the -s option was grabbing the locat branch name based on the
convention that the local branch name was the same as the remote branch
name. This is a bad convention.
Now, the code uses the remote branch with git ls-tree to get a list of
the files to sync.
Jeff Davis [Tue, 14 Jan 2014 01:19:17 +0000 (17:19 -0800)]
deployfile.sh: added sip2 to list of production servers
Liam Whalen [Wed, 8 Jan 2014 19:52:17 +0000 (11:52 -0800)]
Fixed hashref error
The hash retunred by config needs to be cast as a hash. 5.14.2 seems to
do this implicity. But, coconut uses 5.10.1, which does not.
Signed-off-by: Liam Whalen <liam.whalen@bc.libraries.coop>
Liam Whalen [Tue, 17 Dec 2013 22:11:12 +0000 (14:11 -0800)]
[RT18107] Added bibc-prod_pathmap.ini
This ini file is used when git-deploy.sh is called with bibc-prod as one
of the host arguments. git-deploy.sh constructs the pathmap.ini file
name using the host name followed by _pathmap.ini. If that file exists,
then it is passed as the --config argument to access_pathmap.pl.
Signed-off-by: Liam Whalen <liam.whalen@bc.libraries.coop>
Liam Whalen [Mon, 16 Dec 2013 23:00:45 +0000 (15:00 -0800)]
[RT18107] clean up access_pathmap.pl
I left a few artifacts from testing in access_pathmap.pl. These are
removed with this commit.
Signed-off-by: Liam Whalen <liam.whalen@bc.libraries.coop>
Liam Whalen [Mon, 16 Dec 2013 17:48:36 +0000 (09:48 -0800)]
[RT18107] A number of modifications
I added the ability for the scirpt to detect access_pathmap.pl. As
well, temporary files are now placed in
/tmp/${BRANCH}/server_list/year_month_day_hour_minute_second/.
So, if I was pusing user/lwhalen/rt14111 to dev3 and dev4 then my
files from the branch would be located at
/tmp/user/lwhalen/rt14111/dev3_dev4/year_month_day_hour_minute_second/.
If we do not delete the temporary files until space is a concern, then
this will allow us to have a history of what was deployed and when it was
deployed.
I also added some more help file text, and a message indicating when a
file could not be pushed because it does not have a mapping in the
PATHMAP_FILE.
Changed output to go to stderr or stdout as appropriate. This means
error messages are now going to stderr, and the prompt to ensure that
you mean to sync a branch with the servers is going to stdout.
The server list used to create the temporary directory is sorted
using the sort command in order to provide a consistent directory
structure regardless of how the servers are entered on the command line.
git-deploy was changed to send a host sepcific config file to
access_pathmap.pl. The convention I am using is
${HOSTNAME}_pathmap.ini. If this file exist, then access_pathmap.pl is
called with that file as the --config option. I also moved the logic
that determins a hostname from a string to a funciton because it is now
used in two places.
Signed-off-by: Liam Whalen <liam.whalen@bc.libraries.coop>
Liam Whalen [Fri, 13 Dec 2013 23:48:21 +0000 (15:48 -0800)]
[rt18107] added better filtering of production servers
These changes make sure using a server like
app1-1.catalogue.libraries.coop will not deploy currently while testing.
To do this, the script looks at the hostname and compares it to a list
of production servers defined at the start of the script. If the
hostname is within the list of production servers then it aborts sending
the file.
Liam Whalen [Fri, 13 Dec 2013 23:29:02 +0000 (15:29 -0800)]
[rt18107] added branch syncing
By specifying -s you can now sync all files that have a mapping in
pathmap.ini with the server.
Liam Whalen [Mon, 9 Dec 2013 22:57:03 +0000 (14:57 -0800)]
[rt18107] Deploy from git
Pull files from a remote repo. Figure out where they are on the
server. Display the deployfile.sh command that could be executed.
Needs some more work and lots of testing. Eventually it will execute the deployfile.sh
command without the use of a switch.
Working with tmp dir and real filename
Had to change the temp file to use the real file name of the file being
pushed otherwise deployfile.sh would not work properly.
Should we clean up the temp files? I am hesitant to put any rm commands
into a script.
Modifed to work with pathmap.ini and access_pathmap.pl
This script now derives the host directories to deploy to via
pathmap.ini. As well, I put in some safe guards to prevent deploying to
production while the script is in testing.
Added ability to specify location of git repo
Added the ability to specify the location of the git repo. It defaults
to the current directory. This allows users to run git-deploy.sh from a
central directory or from the PATH. This script does assume that
access_pathmap.pl is in the user's PATH.
Liam Whalen [Fri, 13 Dec 2013 18:14:43 +0000 (10:14 -0800)]
[rt18107] Cleaned up access_pathmap.pl
I noticed a few problems with access_pathmap.pl after my initial commmit
to master. First, the ability to retrieve all sections was using a space
' ' as a delimeter between the section names, and a space is a valid
input within a section name, so I changed the space to a newline. As
well, I modified the regex used to edit the section names to strip out [
and ] from the beggining and end of the section names only. The
previous version removed all occurances of [ and ] from a section name,
which may not be the same thing.
Signed-off-by: Liam Whalen <liam.whalen@bc.libraries.coop>
Liam Whalen [Wed, 11 Dec 2013 23:56:00 +0000 (15:56 -0800)]
[rt18107] Extracted the pathmap functionality from integrity-checker.pl
We can use access_pathmap.pl to grab the list of all modules by calling
it with only the --config option and no --component option. If you add
the --component option then the program will return the associated paths
for that component in the INI file specified by --config. If you add
--srcpath it will retrieve the mapping for that srcpath.
access_pathmap.pl now has all the required functionality for
integrity-checker.pl to function. There is one problem I have run into.
Some of the files in /srv/openils/var/web/xul/server are copied from
Open-ILS/xul/staff_client/chrome/content/ and the pathmap.ini does not
account for this, so they show up as untracked. I will try and figure
out how to take this into consideration once I have access_pathmap.pl
working with the git-deploy.sh script.
Signed-off-by: Liam Whalen <liam.whalen@bc.libraries.coop>
Jeff Davis [Wed, 4 Dec 2013 22:32:20 +0000 (14:32 -0800)]
Check that deployed EG code matches the code in git.
In a multi-server environment, it can easily become confusing to track
what changes have been made to which servers. This commit adds a script
to compare parts of the evergreen.git source tree to the corresponding
parts of the file tree on an Evergreen server, using git's internal
hashing mechanism to calculate checksums for various deployed files
which can be compared with the hashes stored by the git repo.
A sample configuration file, pathmap.ini, demonstrates how to (a) map a
directory in the git source tree to the corresponding directory on an
Evergreen server, and (b) group multiple directories together into
"components" so that you can, for example, audit all OpenILS Perl
modules with a single command.
Signed-off-by: Jeff Davis <jdavis@sitka.bclibraries.ca>
Robin H. Johnson [Mon, 2 Dec 2013 16:57:34 +0000 (08:57 -0800)]
Improve error checking before export actually triggers the FTP upload.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Steven Chan [Thu, 28 Nov 2013 23:17:04 +0000 (15:17 -0800)]
Add more patch points to patching tool
The new patch points will allow more deployed software to be patched. The
issue is that these patch points are located in paths different from their
resident paths in the software repository.
Jeff Davis [Fri, 11 Oct 2013 20:37:54 +0000 (13:37 -0700)]
install-eg.sh: log rotation
Jeff Davis [Thu, 26 Sep 2013 05:32:46 +0000 (22:32 -0700)]
adding export scripts for MWPL
Robin H. Johnson [Wed, 18 Sep 2013 14:08:38 +0000 (07:08 -0700)]
Improve strings.
Robin H. Johnson [Tue, 17 Sep 2013 22:22:06 +0000 (15:22 -0700)]
Final code for MUCN EBSCO upload.
Robin H. Johnson [Tue, 17 Sep 2013 20:27:44 +0000 (13:27 -0700)]
Clarify Outlook vs UCN EBSCO scripts.
Robin H. Johnson [Tue, 17 Sep 2013 17:13:24 +0000 (10:13 -0700)]
Update Outlook email notification addresses per Mari Martin.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Wed, 4 Sep 2013 03:17:13 +0000 (03:17 +0000)]
Anita replaces Heather, added Bob.
Jeff Davis [Fri, 23 Aug 2013 22:45:18 +0000 (15:45 -0700)]
install-eg.sh: only install a few locales; create offline circ stuff AFTER setting up opensrf.xml
Jeff Davis [Wed, 31 Jul 2013 18:22:17 +0000 (11:22 -0700)]
install-eg.sh: a few minor improvements
Robin H. Johnson [Tue, 30 Jul 2013 20:44:12 +0000 (13:44 -0700)]
[RT16904] Exclude BMB-LS reading room books from Outlook per request.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Jeff Davis [Wed, 24 Jul 2013 21:21:19 +0000 (14:21 -0700)]
updated install scripts for production 2.4 environment
Jeff Davis [Wed, 26 Jun 2013 18:09:19 +0000 (11:09 -0700)]
install-eg.sh: eg.conf is renamed to 000-evergreen.conf
Jeff Davis [Wed, 26 Jun 2013 18:08:49 +0000 (11:08 -0700)]
deployfile.sh: fix bug with -u option
Robin H. Johnson [Tue, 25 Jun 2013 00:26:39 +0000 (00:26 +0000)]
Add quiet make rules.
Robin H. Johnson [Tue, 25 Jun 2013 00:21:59 +0000 (00:21 +0000)]
Apply new quiet flag.
Robin H. Johnson [Tue, 25 Jun 2013 00:21:52 +0000 (00:21 +0000)]
Also squelch the Retrieving messages.
Robin H. Johnson [Tue, 25 Jun 2013 00:19:09 +0000 (00:19 +0000)]
Add ability to make it run quietly to reduce mail size.
Jeff Davis [Thu, 20 Jun 2013 20:01:56 +0000 (13:01 -0700)]
install-eg.sh: setup offline circ
Jeff Davis [Fri, 14 Jun 2013 19:58:27 +0000 (12:58 -0700)]
Further updates to install scripts for EG 2.4.0 and OpenSRF 2.2.0
Jeff Davis [Wed, 22 May 2013 00:32:09 +0000 (17:32 -0700)]
Update install scripts for EG 2.4.0 and OpenSRF 2.2.0
Jeff Davis [Wed, 19 Jun 2013 20:52:34 +0000 (13:52 -0700)]
parse-osrf-xml.pl: show user and password in output
Signed-off-by: Jeff Davis <jdavis@sitka.bclibraries.ca>
Jeff Davis [Tue, 28 May 2013 01:28:28 +0000 (18:28 -0700)]
deployfile.sh: add option to auto-detect destination path; also optional verbose output
Signed-off-by: Jeff Davis <jdavis@sitka.bclibraries.ca>
Robin H. Johnson [Thu, 18 Apr 2013 03:51:39 +0000 (03:51 +0000)]
circmod renaming: ill-no-renew -> ill-no-renewal.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Robin H. Johnson [Wed, 17 Apr 2013 19:19:41 +0000 (19:19 +0000)]
Fix order of precedence.
Robin H. Johnson [Thu, 4 Apr 2013 18:25:46 +0000 (18:25 +0000)]
Removing BGIC, BMIS, BSI from Outlook per BCGov
Date: 4 Apr 2013 11:20:32 -0700
From: "Martin, Mari EDUC:EX" <Mari.Martin@gov...>
BGIC, BMIS and BSI are not libraries under the Library Act. They do not
directly receive provincial funding and do not participate as lenders in
the Inter-library loan program which the OutLook Online Catalogue is
used for--therefore their records do not need to be uploaded.
Robin H. Johnson [Thu, 4 Apr 2013 17:38:15 +0000 (17:38 +0000)]
Since MWP was moved to the GOVLIBS orgunit parent, we need to exclude it explicitly.
Robin H. Johnson [Thu, 4 Apr 2013 17:36:25 +0000 (17:36 +0000)]
Anne Morgan has been replaced by Martin Mari.
kreed [Thu, 28 Mar 2013 19:05:34 +0000 (12:05 -0700)]
adding new flag for deployfile.sh for easy deploy to all production
Robin H. Johnson [Tue, 12 Feb 2013 23:29:38 +0000 (23:29 +0000)]
Implement NVIT export settings.
Signed-off-by: Robin H. Johnson <rjohnson@sitka.bclibraries.ca>
Jeff Davis [Tue, 5 Feb 2013 18:33:39 +0000 (10:33 -0800)]
deployment: updated install scripts to EG 2.2.5 and OpenSRF 2.1.2
Jeff Davis [Wed, 2 Jan 2013 23:23:54 +0000 (15:23 -0800)]
deployment: use apt to install Perl modules required by deletepatron:
HTML::Template (libhtml-template-perl)
CGI::Session (libcgi-session-perl)
Steven Chan [Tue, 4 Dec 2012 00:49:05 +0000 (16:49 -0800)]
Apply or unapply a patch to remote Evergreen hosts
Robin H. Johnson [Mon, 3 Dec 2012 05:19:58 +0000 (05:19 +0000)]
Update email text.
Robin H. Johnson [Mon, 3 Dec 2012 05:18:53 +0000 (05:18 +0000)]
Error checking and paths.
James Fournie [Tue, 20 Nov 2012 21:50:22 +0000 (13:50 -0800)]
adding indb reindexing tool
Robin H. Johnson [Sun, 4 Nov 2012 21:31:17 +0000 (13:31 -0800)]
Fix email run part.
Robin H. Johnson [Sun, 4 Nov 2012 16:47:58 +0000 (08:47 -0800)]
Exclude SITKA Springfield.
Robin H. Johnson [Sun, 4 Nov 2012 16:45:37 +0000 (08:45 -0800)]
Ensure dir always works absolutely.
Robin H. Johnson [Sun, 4 Nov 2012 16:42:34 +0000 (08:42 -0800)]
Lets see if we can make this better for outlook.
Robin H. Johnson [Sun, 4 Nov 2012 16:42:19 +0000 (08:42 -0800)]
Whitespace.
Robin H. Johnson [Sun, 4 Nov 2012 16:42:12 +0000 (08:42 -0800)]
Template help.
Jeff Davis [Wed, 24 Oct 2012 20:38:57 +0000 (13:38 -0700)]
deployment: include /etc/apache2/envvars in EG install
Jeff Davis [Wed, 26 Sep 2012 19:09:00 +0000 (12:09 -0700)]
deployment: add staff client start page
Jeff Davis [Wed, 26 Sep 2012 18:16:45 +0000 (11:16 -0700)]
deployment: fix to deploy bclibraries skin correctly
Jeff Davis [Wed, 26 Sep 2012 00:58:08 +0000 (17:58 -0700)]
deployment: fix ejabberd setup
Jeff Davis [Wed, 26 Sep 2012 00:22:47 +0000 (17:22 -0700)]
deployment: require manually-supplied ejabberd passwords in install-osrf.sh
Jeff Davis [Tue, 25 Sep 2012 23:49:06 +0000 (16:49 -0700)]
added automated deployment tools
Robin H. Johnson [Thu, 16 Aug 2012 05:44:02 +0000 (22:44 -0700)]
More export tools by James I think.
Robin H. Johnson [Thu, 16 Aug 2012 05:42:49 +0000 (22:42 -0700)]
new stat tool.
Robin H. Johnson [Thu, 16 Aug 2012 05:42:27 +0000 (22:42 -0700)]
Fix hostname.
Robin H. Johnson [Thu, 16 Aug 2012 05:39:23 +0000 (05:39 +0000)]
Update inclusion rules.
James Fournie [Mon, 21 May 2012 22:19:39 +0000 (15:19 -0700)]
isolating the existence of the non multi-session into the only function that uses it
James Fournie [Fri, 18 May 2012 21:13:38 +0000 (14:13 -0700)]
improved BSLW script with the final requirements
James Fournie [Fri, 18 May 2012 21:12:44 +0000 (14:12 -0700)]
adding experimental MultiSession marc_export_custom
James Fournie [Fri, 4 May 2012 18:01:24 +0000 (11:01 -0700)]
Merge branch 'master' of git+ssh://git.sitka.bclibraries.ca/sitka/sitka-tools
James Fournie [Fri, 4 May 2012 18:00:48 +0000 (11:00 -0700)]
Script for loading a master set of records from BSLW for merging
Robin H. Johnson [Mon, 16 Apr 2012 22:58:02 +0000 (15:58 -0700)]
Add placeholders for NVIT.