Discussion:
upcoming downtime on Monday
Mark Abraham
2014-09-13 11:28:22 UTC
Permalink
Hi,

The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer Gerrit
version out that has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins and Redmine are
probably OK for now. We should bump our icc versions, but we don't need a
downtime for that. Anything else people can think of we should fix?

Mark
David van der Spoel
2014-09-14 06:49:55 UTC
Permalink
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer
Gerrit version out that has a bug fix that I'm keen to use, so I'll also
upgrade Gerrit on Monday so we have less overall downtime. Jenkins and
Redmine are probably OK for now. We should bump our icc versions, but we
don't need a downtime for that. Anything else people can think of we
should fix?
Mark
Making the build cycles faster would be appreciated :)
--
David van der Spoel, Ph.D., Professor of Biology
Dept. of Cell & Molec. Biol., Uppsala University.
Box 596, 75124 Uppsala, Sweden. Phone: +46184714205.
***@xray.bmc.uu.se http://folding.bmc.uu.se
--
Gromacs Developers mailing list

* Please search the archive at http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before posting!

* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists

* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or send a mail to gmx-developers-***@gromacs.org.
Roland Schulz
2014-09-14 17:32:14 UTC
Permalink
Hi,

we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes the
issue that the matrix job isn't canceled when a newer change is uploaded:
https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which will include
the patch isn't out yet. Let me know - it should be easy for me to build it.

Roland
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer Gerrit
version out that has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins and Redmine are
probably OK for now. We should bump our icc versions, but we don't need a
downtime for that. Anything else people can think of we should fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
Mark Abraham
2014-09-15 13:20:09 UTC
Permalink
Hi,

We now have gerrit 2.9.1 deployed, and bs_mac upgraded to Mavericks and
XCode 5.1. Everything should be usable, do yell if not! If bs_mac + icc
still misbehaves then we'll bump icc version or something.
Post by Roland Schulz
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes the
https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which will include
the patch isn't out yet. Let me know - it should be easy for me to build it.
Sounds good. I am out of time for this today, but if you can build it then
we can deploy it without taking gerrit down.

Mark

Roland
Post by Roland Schulz
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer Gerrit
version out that has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins and Redmine are
probably OK for now. We should bump our icc versions, but we don't need a
downtime for that. Anything else people can think of we should fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
Mark Abraham
2014-09-18 15:01:56 UTC
Permalink
Post by Mark Abraham
Hi,
We now have gerrit 2.9.1 deployed, and bs_mac upgraded to Mavericks and
XCode 5.1. Everything should be usable, do yell if not! If bs_mac + icc
still misbehaves then we'll bump icc version or something.
Hi,

After several unanticipated this-isn't-compatible-with-that issues, the
infrastructure is now stable on both release-5-0 and master branch CI
testing. Yay, back to work!

Mark
Post by Mark Abraham
Post by Roland Schulz
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes the
https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which will
include the patch isn't out yet. Let me know - it should be easy for me to
build it.
Sounds good. I am out of time for this today, but if you can build it then
we can deploy it without taking gerrit down.
Mark
Roland
Post by Roland Schulz
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer Gerrit
version out that has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins and Redmine are
probably OK for now. We should bump our icc versions, but we don't need a
downtime for that. Anything else people can think of we should fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
Roland Schulz
2014-09-16 05:15:09 UTC
Permalink
Post by Mark Abraham
Hi,
We now have gerrit 2.9.1 deployed, and bs_mac upgraded to Mavericks and
XCode 5.1. Everything should be usable, do yell if not! If bs_mac + icc
still misbehaves then we'll bump icc version or something.
Jenkins cannot start on bs_mac. It cannot find java. I also get an error
trying to start java on the console.
Post by Mark Abraham
Post by Roland Schulz
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes the
https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which will
include the patch isn't out yet. Let me know - it should be easy for me to
build it.
Sounds good. I am out of time for this today, but if you can build it
then we can deploy it without taking gerrit down.
I updated the Gerrit-Trigger plugin. Let us know if any problems occur.

Roland
Post by Mark Abraham
Mark
Roland
Post by Roland Schulz
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer Gerrit
version out that has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins and Redmine are
probably OK for now. We should bump our icc versions, but we don't need a
downtime for that. Anything else people can think of we should fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
Rossen Apostolov
2014-09-16 07:11:10 UTC
Permalink
Hi,

Upgrading to Mavericks has automatically removed previous Java
installations. I installed the latest version:

$ java -version
java version "1.8.0_20"
Java(TM) SE Runtime Environment (build 1.8.0_20-b26)
Java HotSpot(TM) 64-Bit Server VM (build 25.20-b23, mixed mode)


Cheers
Rossen
On Mon, Sep 15, 2014 at 9:20 AM, Mark Abraham
Hi,
We now have gerrit 2.9.1 deployed, and bs_mac upgraded to
Mavericks and XCode 5.1. Everything should be usable, do yell if
not! If bs_mac + icc still misbehaves then we'll bump icc version
or something.
Jenkins cannot start on bs_mac. It cannot find java. I also get an
error trying to start java on the console.
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It
fixes the issue that the matrix job isn't canceled when a
https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which
will include the patch isn't out yet. Let me know - it should
be easy for me to build it.
Sounds good. I am out of time for this today, but if you can build
it then we can deploy it without taking gerrit down.
I updated the Gerrit-Trigger plugin. Let us know if any problems occur.
Roland
Mark
Roland
On Sat, Sep 13, 2014 at 7:28 AM, Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up
with Xcode versions, which we hope will fix the way the
mac+icc CI build segfaults occasionally. Rossen's going to
do that on Monday. There's a newer Gerrit version out that
has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins
and Redmine are probably OK for now. We should bump our
icc versions, but we don't need a downtime for that.
Anything else people can think of we should fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
<http://cmb.ornl.gov>
865-241-1537 <tel:865-241-1537>, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List
before posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov <http://cmb.ornl.gov>
865-241-1537, ORNL PO BOX 2008 MS6309
David van der Spoel
2014-09-16 10:19:49 UTC
Permalink
Seems that we have compiler problems now (full link
http://jenkins.gromacs.org/job/Gromacs_Gerrit_master/6815/OPTIONS=Compiler=icc%20CompilerVersion=13.0.1%20GMX_GPU=OFF%20GMX_OPENMP=ON%20NTOMP=1%20GMX_THREAD_MPI=OFF%20host=bs_mac,label=bs_mac/console)


11:41:34 The C compiler
"/opt/intel/composer_xe_2013.5.198/bin/intel64/icc" is not
11:41:34 able to compile a simple test program.
11:41:34
11:41:34 It fails with the following output:
11:41:34
11:41:34 Change Dir:
/Volumes/workspace/***@2/5e828153/gromacs/CMakeFiles/CMakeTmp
11:41:34
11:41:34
11:41:34
11:41:34 Run Build Command:"/usr/bin/make"
"cmTryCompileExec4212583335/fast"
11:41:34
11:41:34 /Applications/Xcode.app/Contents/Developer/usr/bin/make -f
11:41:34 CMakeFiles/cmTryCompileExec4212583335.dir/build.make
11:41:34 CMakeFiles/cmTryCompileExec4212583335.dir/build
11:41:34
11:41:34 /opt/local/bin/cmake -E cmake_progress_report
11:41:34
/Volumes/workspace/***@2/5e828153/gromacs/CMakeFiles/CMakeTmp/CMakeFiles
11:41:34 1
11:41:34
11:41:34 Building C object
11:41:34 CMakeFiles/cmTryCompileExec4212583335.dir/testCCompiler.c.o
11:41:34
11:41:34 /opt/intel/composer_xe_2013.5.198/bin/intel64/icc -o
11:41:34 CMakeFiles/cmTryCompileExec4212583335.dir/testCCompiler.c.o -c
11:41:34
/Volumes/workspace/***@2/5e828153/gromacs/CMakeFiles/CMakeTmp/testCCompiler.c
11:41:34
11:41:34
11:41:34 Linking C executable cmTryCompileExec4212583335
11:41:34
11:41:34 /opt/local/bin/cmake -E cmake_link_script
11:41:34 CMakeFiles/cmTryCompileExec4212583335.dir/link.txt --verbose=1
11:41:34
11:41:34 /opt/intel/composer_xe_2013.5.198/bin/intel64/icc
-Wl,-search_paths_first
11:41:34 -Wl,-headerpad_max_install_names
11:41:34 CMakeFiles/cmTryCompileExec4212583335.dir/testCCompiler.c.o -o
11:41:34 cmTryCompileExec4212583335
11:41:34
11:41:34 ld: library not found for -lcrt1.10.6.o
11:41:34
11:41:34 make[1]: *** [cmTryCompileExec4212583335] Error 1
11:41:34
11:41:34 make: *** [cmTryCompileExec4212583335/fast] Error 2
--
David van der Spoel, Ph.D., Professor of Biology
Dept. of Cell & Molec. Biol., Uppsala University.
Box 596, 75124 Uppsala, Sweden. Phone: +46184714205.
***@xray.bmc.uu.se http://folding.bmc.uu.se
--
Gromacs Developers mailing list

* Please search the archive at http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before posting!

* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists

* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or send a mail to gmx-developers-***@gromacs.org.
David van der Spoel
2014-09-16 12:33:12 UTC
Permalink
That doesn't work at all, does it?

Here's the error message:
http://jenkins.gromacs.org/job/Gromacs_Gerrit_master/6818/OPTIONS=Compiler=gcc%20CompilerVersion=4.2%20GMX_GPU=OFF%20GMX_OPENMP=OFF%20host=bs_mac,label=bs_mac/testReport/junit/%28root%29/ValgrindTests/CommandLineUnitTests/

Stacktrace

bad executable
/Volumes/workspace/Gromacs_Gerrit_master/b4b4198a/gromacs/bin/commandline-test
(no stack)
valgrind:
/Volumes/workspace/Gromacs_Gerrit_master/b4b4198a/gromacs/bin/commandline-test:
cannot execute binary file
--
David van der Spoel, Ph.D., Professor of Biology
Dept. of Cell & Molec. Biol., Uppsala University.
Box 596, 75124 Uppsala, Sweden. Phone: +46184714205.
***@xray.bmc.uu.se http://folding.bmc.uu.se
--
Gromacs Developers mailing list

* Please search the archive at http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before posting!

* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists

* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or send a mail to gmx-developers-***@gromacs.org.
Teemu Murtola
2014-09-16 12:44:19 UTC
Permalink
Well, it worked before the OS was upgraded to a version for which there was
no support in valgrind until a week ago, and I assume that the valgrind
binary is still the one that was there earlier.

All the other issues are probably also caused by software that is not
configured correctly after the OS upgrade (hopefully, all the pieces can be
made work on Mavericks...).
Post by David van der Spoel
That doesn't work at all, does it?
http://jenkins.gromacs.org/job/Gromacs_Gerrit_master/
6818/OPTIONS=Compiler=gcc%20CompilerVersion=4.2%20GMX_
GPU=OFF%20GMX_OPENMP=OFF%20host=bs_mac,label=bs_mac/
testReport/junit/%28root%29/ValgrindTests/CommandLineUnitTests/
Stacktrace
bad executable /Volumes/workspace/Gromacs_Gerrit_master/b4b4198a/gromacs/bin/commandline-test
(no stack)
cannot execute binary file
--
David van der Spoel, Ph.D., Professor of Biology
Dept. of Cell & Molec. Biol., Uppsala University.
Box 596, 75124 Uppsala, Sweden. Phone: +46184714205.
--
Gromacs Developers mailing list
* Please search the archive at http://www.gromacs.org/
Support/Mailing_Lists/GMX-developers_List before posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
Roland Schulz
2014-09-18 18:09:29 UTC
Permalink
Hi,

I suggest we change the gerrit setting change.largeChange from 500 to 1000
(at what point the size bar is red). Also I think we should try harder to
break changes into small easy reviewable patches. Changes such as:
https://gerrit.gromacs.org/#/c/3471 are too big to be reviewed efficiencly.

Roland
Post by Mark Abraham
Hi,
We now have gerrit 2.9.1 deployed, and bs_mac upgraded to Mavericks and
XCode 5.1. Everything should be usable, do yell if not! If bs_mac + icc
still misbehaves then we'll bump icc version or something.
Post by Roland Schulz
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes the
https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which will
include the patch isn't out yet. Let me know - it should be easy for me to
build it.
Sounds good. I am out of time for this today, but if you can build it
then we can deploy it without taking gerrit down.
Mark
Roland
Post by Roland Schulz
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer Gerrit
version out that has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins and Redmine are
probably OK for now. We should bump our icc versions, but we don't need a
downtime for that. Anything else people can think of we should fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
Mark Abraham
2014-09-18 21:55:09 UTC
Permalink
Post by Roland Schulz
Hi,
I suggest we change the gerrit setting change.largeChange from 500 to
1000 (at what point the size bar is red).
Sounds good for the forseeable future. Not sure where it is - if you know,
please do it.
Post by Roland Schulz
Also I think we should try harder to break changes into small easy
reviewable patches. Changes such as: https://gerrit.gromacs.org/#/c/3471
are too big to be reviewed efficiencly.
True, but it'd be nice also if we were all a little more cooperative with
reviewing low-impact patches (e.g. clean up or file renaming that doesn't
change functionality) so that people aren't tempted to write monolithic
patches (where, when their ship comes in, they all come in at once...). For
example, having gone a fair way into development of 3471, David might
recognize that he could split that patch into
1. move the existing functionality into the newly named files, get most of
the tools to call it from the new place in the old way
2. import lmfit, change existing functionality to use it, add tests
3. any genuinely new stuff (if any; not apparent to me right now)

Patch 1 ought to be easy and fast to review (no functional changes), and
patch 2 should be faster to review than 1+2 altogether. Today, I did some
review on "new-seeming" code in 3471 that upon closer inspection was just
old code moved to a new file - had I submitted that part of my review,
David would likely have had to say "well, sure, but that's not code I
wrote, or that I'm working on here." The split of 1 & 2 would make that
clear to reviewers up front.

That said, I've had poor experiences with (say)
https://gerrit.gromacs.org/#/q/topic:g-tune-pme-reform, where people have
reviewed some changes and not enough people have reviewed their pre-reqs,
etc. I have a bunch more (IMO) decently atomic commits for fixing tune-pme
sitting in a long-forgotten repo on a drive... I can't say
https://gerrit.gromacs.org/#/q/topic:bondeds has been a compelling
experience, either. I don't mean this as criticism of any one or any group
- but I do think that with more than 100 outstanding patches in Gerrit and
a long-time-average merge rate of about 2 per day (
https://gerrit.gromacs.org/#/q/project:gromacs+status:merged), we all need
to pitch in harder with review and review-response, and less on doing our
own cool new things.

Mark

Roland
Post by Roland Schulz
Post by Mark Abraham
Hi,
We now have gerrit 2.9.1 deployed, and bs_mac upgraded to Mavericks and
XCode 5.1. Everything should be usable, do yell if not! If bs_mac + icc
still misbehaves then we'll bump icc version or something.
Post by Roland Schulz
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes the
https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which will
include the patch isn't out yet. Let me know - it should be easy for me to
build it.
Sounds good. I am out of time for this today, but if you can build it
then we can deploy it without taking gerrit down.
Mark
Roland
Post by Roland Schulz
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer Gerrit
version out that has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins and Redmine are
probably OK for now. We should bump our icc versions, but we don't need a
downtime for that. Anything else people can think of we should fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
Roland Schulz
2014-09-20 17:22:38 UTC
Permalink
Hi,

I think we also need to do something about the "Not enough memory." errors
with which the MdrunTests sometimes fails. It is currently probably one of
the leading causes of false positives. Example:
http://jenkins.gromacs.org/job/Gromacs_Gerrit_5_0/958/. Not sure if it is
enough to increase the memory or decrease the number of jobs executed in
parallel.

Roland
Post by Mark Abraham
Post by Roland Schulz
Hi,
I suggest we change the gerrit setting change.largeChange from 500 to
1000 (at what point the size bar is red).
Sounds good for the forseeable future. Not sure where it is - if you
know, please do it.
Post by Roland Schulz
Also I think we should try harder to break changes into small easy
reviewable patches. Changes such as: https://gerrit.gromacs.org/#/c/3471
are too big to be reviewed efficiencly.
True, but it'd be nice also if we were all a little more cooperative
with reviewing low-impact patches (e.g. clean up or file renaming that
doesn't change functionality) so that people aren't tempted to write
monolithic patches (where, when their ship comes in, they all come in at
once...). For example, having gone a fair way into development of 3471,
David might recognize that he could split that patch into
1. move the existing functionality into the newly named files, get most of
the tools to call it from the new place in the old way
2. import lmfit, change existing functionality to use it, add tests
3. any genuinely new stuff (if any; not apparent to me right now)
Patch 1 ought to be easy and fast to review (no functional changes), and
patch 2 should be faster to review than 1+2 altogether. Today, I did some
review on "new-seeming" code in 3471 that upon closer inspection was just
old code moved to a new file - had I submitted that part of my review,
David would likely have had to say "well, sure, but that's not code I
wrote, or that I'm working on here." The split of 1 & 2 would make that
clear to reviewers up front.
That said, I've had poor experiences with (say)
https://gerrit.gromacs.org/#/q/topic:g-tune-pme-reform, where people have
reviewed some changes and not enough people have reviewed their pre-reqs,
etc. I have a bunch more (IMO) decently atomic commits for fixing tune-pme
sitting in a long-forgotten repo on a drive... I can't say
https://gerrit.gromacs.org/#/q/topic:bondeds has been a compelling
experience, either. I don't mean this as criticism of any one or any group
- but I do think that with more than 100 outstanding patches in Gerrit and
a long-time-average merge rate of about 2 per day (
https://gerrit.gromacs.org/#/q/project:gromacs+status:merged), we all
need to pitch in harder with review and review-response, and less on doing
our own cool new things.
Mark
Roland
Post by Roland Schulz
Post by Mark Abraham
Hi,
We now have gerrit 2.9.1 deployed, and bs_mac upgraded to Mavericks
and XCode 5.1. Everything should be usable, do yell if not! If bs_mac + icc
still misbehaves then we'll bump icc version or something.
Post by Roland Schulz
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes
the issue that the matrix job isn't canceled when a newer change is
uploaded: https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which will
include the patch isn't out yet. Let me know - it should be easy for me to
build it.
Sounds good. I am out of time for this today, but if you can build it
then we can deploy it without taking gerrit down.
Mark
Roland
Post by Roland Schulz
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with
Xcode versions, which we hope will fix the way the mac+icc CI build
segfaults occasionally. Rossen's going to do that on Monday. There's a
newer Gerrit version out that has a bug fix that I'm keen to use, so I'll
also upgrade Gerrit on Monday so we have less overall downtime. Jenkins and
Redmine are probably OK for now. We should bump our icc versions, but we
don't need a downtime for that. Anything else people can think of we should
fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List
before posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
Szilárd Páll
2014-09-20 18:40:56 UTC
Permalink
Hi,

I can increase the memory of the VM, that's not an issue at all.
However, are we really using more than 3 GB of memory with just 5
executors? I was just checking the load and it looked like we maxed
out the memory even with four jobs running:
http://jenkins.gromacs.org/metrics/graph_all_periods.php?h=bs_centos63&m=load_one&r=week&s=by%20name&hc=0&mc=2&st=1411237442&g=mem_report&z=large&c=jenkins

--
Szilárd
Post by Roland Schulz
Hi,
I think we also need to do something about the "Not enough memory." errors
with which the MdrunTests sometimes fails. It is currently probably one of
http://jenkins.gromacs.org/job/Gromacs_Gerrit_5_0/958/. Not sure if it is
enough to increase the memory or decrease the number of jobs executed in
parallel.
Roland
Post by Mark Abraham
Post by Roland Schulz
Hi,
I suggest we change the gerrit setting change.largeChange from 500 to
1000 (at what point the size bar is red).
Sounds good for the forseeable future. Not sure where it is - if you know,
please do it.
Post by Roland Schulz
Also I think we should try harder to break changes into small easy
reviewable patches. Changes such as: https://gerrit.gromacs.org/#/c/3471 are
too big to be reviewed efficiencly.
True, but it'd be nice also if we were all a little more cooperative with
reviewing low-impact patches (e.g. clean up or file renaming that doesn't
change functionality) so that people aren't tempted to write monolithic
patches (where, when their ship comes in, they all come in at once...). For
example, having gone a fair way into development of 3471, David might
recognize that he could split that patch into
1. move the existing functionality into the newly named files, get most of
the tools to call it from the new place in the old way
2. import lmfit, change existing functionality to use it, add tests
3. any genuinely new stuff (if any; not apparent to me right now)
Patch 1 ought to be easy and fast to review (no functional changes), and
patch 2 should be faster to review than 1+2 altogether. Today, I did some
review on "new-seeming" code in 3471 that upon closer inspection was just
old code moved to a new file - had I submitted that part of my review, David
would likely have had to say "well, sure, but that's not code I wrote, or
that I'm working on here." The split of 1 & 2 would make that clear to
reviewers up front.
That said, I've had poor experiences with (say)
https://gerrit.gromacs.org/#/q/topic:g-tune-pme-reform, where people have
reviewed some changes and not enough people have reviewed their pre-reqs,
etc. I have a bunch more (IMO) decently atomic commits for fixing tune-pme
sitting in a long-forgotten repo on a drive... I can't say
https://gerrit.gromacs.org/#/q/topic:bondeds has been a compelling
experience, either. I don't mean this as criticism of any one or any group -
but I do think that with more than 100 outstanding patches in Gerrit and a
long-time-average merge rate of about 2 per day
(https://gerrit.gromacs.org/#/q/project:gromacs+status:merged), we all need
to pitch in harder with review and review-response, and less on doing our
own cool new things.
Mark
Post by Roland Schulz
Roland
Post by Mark Abraham
Hi,
We now have gerrit 2.9.1 deployed, and bs_mac upgraded to Mavericks and
XCode 5.1. Everything should be usable, do yell if not! If bs_mac + icc
still misbehaves then we'll bump icc version or something.
Post by Roland Schulz
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes the
https://issues.jenkins-ci.org/browse/JENKINS-24295
We would need to build it ourselves because 2.12-beta-5 which will
include the patch isn't out yet. Let me know - it should be easy for me to
build it.
Sounds good. I am out of time for this today, but if you can build it
then we can deploy it without taking gerrit down.
Mark
Post by Roland Schulz
Roland
On Sat, Sep 13, 2014 at 7:28 AM, Mark Abraham
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with Xcode
versions, which we hope will fix the way the mac+icc CI build segfaults
occasionally. Rossen's going to do that on Monday. There's a newer Gerrit
version out that has a bug fix that I'm keen to use, so I'll also upgrade
Gerrit on Monday so we have less overall downtime. Jenkins and Redmine are
probably OK for now. We should bump our icc versions, but we don't need a
downtime for that. Anything else people can think of we should fix?
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or
--
Gromacs Developers mailing list

* Please search the archive at http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before posting!

* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists

* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or send a mai
Mark Abraham
2014-09-20 23:46:38 UTC
Permalink
Post by Roland Schulz
Hi,
I think we also need to do something about the "Not enough memory."
errors with which the MdrunTests sometimes fails. It is currently probably
one of the leading causes of false positives. Example:
http://jenkins.gromacs.org/job/Gromacs_Gerrit_5_0/958/. Not sure if it is
enough to increase the memory or decrease the number of jobs executed in
parallel.

I only ever see that one when building on a VM, but never via Jenkins! I
suspect it is some data structure in grompp having state and/or not being
initialized properly, but having virtual memory on a real machine makes it
go unnoticed. The problem could probably be found by noting whenever snew
tries to allocate more than (say) 1MB, but I haven't prioritized doing it.

Mark
Post by Roland Schulz
Roland
Post by Mark Abraham
Post by Roland Schulz
Hi,
I suggest we change the gerrit setting change.largeChange from 500 to
1000 (at what point the size bar is red).
Post by Roland Schulz
Post by Mark Abraham
Sounds good for the forseeable future. Not sure where it is - if you
know, please do it.
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Also I think we should try harder to break changes into small easy
reviewable patches. Changes such as: https://gerrit.gromacs.org/#/c/3471
are too big to be reviewed efficiencly.
Post by Roland Schulz
Post by Mark Abraham
True, but it'd be nice also if we were all a little more cooperative
with reviewing low-impact patches (e.g. clean up or file renaming that
doesn't change functionality) so that people aren't tempted to write
monolithic patches (where, when their ship comes in, they all come in at
once...). For example, having gone a fair way into development of 3471,
David might recognize that he could split that patch into
Post by Roland Schulz
Post by Mark Abraham
1. move the existing functionality into the newly named files, get most
of the tools to call it from the new place in the old way
Post by Roland Schulz
Post by Mark Abraham
2. import lmfit, change existing functionality to use it, add tests
3. any genuinely new stuff (if any; not apparent to me right now)
Patch 1 ought to be easy and fast to review (no functional changes), and
patch 2 should be faster to review than 1+2 altogether. Today, I did some
review on "new-seeming" code in 3471 that upon closer inspection was just
old code moved to a new file - had I submitted that part of my review,
David would likely have had to say "well, sure, but that's not code I
wrote, or that I'm working on here." The split of 1 & 2 would make that
clear to reviewers up front.
Post by Roland Schulz
Post by Mark Abraham
That said, I've had poor experiences with (say)
https://gerrit.gromacs.org/#/q/topic:g-tune-pme-reform, where people have
reviewed some changes and not enough people have reviewed their pre-reqs,
etc. I have a bunch more (IMO) decently atomic commits for fixing tune-pme
sitting in a long-forgotten repo on a drive... I can't say
https://gerrit.gromacs.org/#/q/topic:bondeds has been a compelling
experience, either. I don't mean this as criticism of any one or any group
- but I do think that with more than 100 outstanding patches in Gerrit and
a long-time-average merge rate of about 2 per day (
https://gerrit.gromacs.org/#/q/project:gromacs+status:merged), we all need
to pitch in harder with review and review-response, and less on doing our
own cool new things.
Post by Roland Schulz
Post by Mark Abraham
Mark
Post by Roland Schulz
Roland
Post by Mark Abraham
Hi,
We now have gerrit 2.9.1 deployed, and bs_mac upgraded to Mavericks
and XCode 5.1. Everything should be usable, do yell if not! If bs_mac + icc
still misbehaves then we'll bump icc version or something.
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Hi,
we could install Gerrit-Trigger Jenkins-plugin 2.12-beta. It fixes
the issue that the matrix job isn't canceled when a newer change is
uploaded: https://issues.jenkins-ci.org/browse/JENKINS-24295
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
We would need to build it ourselves because 2.12-beta-5 which will
include the patch isn't out yet. Let me know - it should be easy for me to
build it.
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Post by Mark Abraham
Sounds good. I am out of time for this today, but if you can build it
then we can deploy it without taking gerrit down.
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Post by Mark Abraham
Mark
Post by Roland Schulz
Roland
On Sat, Sep 13, 2014 at 7:28 AM, Mark Abraham <
Post by Mark Abraham
Hi,
The Jenkins Mac build slave needs an OS upgrade to keep up with
Xcode versions, which we hope will fix the way the mac+icc CI build
segfaults occasionally. Rossen's going to do that on Monday. There's a
newer Gerrit version out that has a bug fix that I'm keen to use, so I'll
also upgrade Gerrit on Monday so we have less overall downtime. Jenkins and
Redmine are probably OK for now. We should bump our icc versions, but we
don't need a downtime for that. Anything else people can think of we should
fix?
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Post by Mark Abraham
Mark
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
Post by Roland Schulz
Post by Mark Abraham
Post by Roland Schulz
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
Post by Roland Schulz
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
or send a mail to gmx-developers-***@gromacs.org.
David van der Spoel
2014-09-22 21:10:34 UTC
Permalink
Hi,

I have two patches in gerrit that are both still under review. How do I
make, in hindsight, patch 2 depend on patch 1, such that I can use the
code from patch 1 in patch 2?

Thanks,
--
David van der Spoel, Ph.D., Professor of Biology
Dept. of Cell & Molec. Biol., Uppsala University.
Box 596, 75124 Uppsala, Sweden. Phone: +46184714205.
***@xray.bmc.uu.se http://folding.bmc.uu.se
--
Gromacs Developers mailing list

* Please search the archive at http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before posting!

* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists

* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or send a mail to gmx-developers-***@gromacs.org.
Szilárd Páll
2014-09-22 21:15:27 UTC
Permalink
Hi,

If you push Patch 2 based on Patch 1 and the latter is already in
gerrit, the dependency should show up. You can even push a branch with
multiple commits; theses will show up as a chain of dependent changes
in gerrit.

--
Szilárd


On Mon, Sep 22, 2014 at 11:10 PM, David van der Spoel
Post by David van der Spoel
Hi,
I have two patches in gerrit that are both still under review. How do I
make, in hindsight, patch 2 depend on patch 1, such that I can use the code
from patch 1 in patch 2?
Thanks,
--
David van der Spoel, Ph.D., Professor of Biology
Dept. of Cell & Molec. Biol., Uppsala University.
Box 596, 75124 Uppsala, Sweden. Phone: +46184714205.
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or
--
Gromacs Developers mailing list

* Please search the archive at http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before posting!

* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists

* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers or send a mail to gmx-develo
Mark Abraham
2014-09-23 03:32:42 UTC
Permalink
Yep. Gerrit uses the ChangeId for recognizing logical equivalence, and
assumes that the state of your repo at the time of your push to gerrit is
how you would want the git history to look if the patches were then
submitted immediately. So you can always push a chain of patches, and if
gerrit recognizes any ChangeId, that change gets updated with new content
and dependencies. I did this on the weekend for making 3952 depend on 4077.

Mark
Post by Szilárd Páll
Hi,
If you push Patch 2 based on Patch 1 and the latter is already in
gerrit, the dependency should show up. You can even push a branch with
multiple commits; theses will show up as a chain of dependent changes
in gerrit.
--
Szilárd
On Mon, Sep 22, 2014 at 11:10 PM, David van der Spoel
Post by David van der Spoel
Hi,
I have two patches in gerrit that are both still under review. How do I
make, in hindsight, patch 2 depend on patch 1, such that I can use the
code
Post by David van der Spoel
from patch 1 in patch 2?
Thanks,
--
David van der Spoel, Ph.D., Professor of Biology
Dept. of Cell & Molec. Biol., Uppsala University.
Box 596, 75124 Uppsala, Sweden. Phone: +46184714205.
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
or
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
Roland Schulz
2014-09-22 21:20:47 UTC
Permalink
Hi,

you cherry-pick or rebase one commit onto the other.

Roland
Post by David van der Spoel
Hi,
I have two patches in gerrit that are both still under review. How do I
make, in hindsight, patch 2 depend on patch 1, such that I can use the
code from patch 1 in patch 2?
Thanks,
--
David van der Spoel, Ph.D., Professor of Biology
Dept. of Cell & Molec. Biol., Uppsala University.
Box 596, 75124 Uppsala, Sweden. Phone: +46184714205.
--
Gromacs Developers mailing list
* Please search the archive at
http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List before
posting!
* Can't post? Read http://www.gromacs.org/Support/Mailing_Lists
* For (un)subscribe requests visit
https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
Loading...