https://clonwiki0.jlab.org/wiki/api.php?action=feedcontributions&feedformat=atom&user=Boiarino
CLONWiki - User contributions [en]
2026-10-06T20:32:12Z
User contributions
MediaWiki 1.42.1
https://clonwiki0.jlab.org/wiki/index.php?title=GIT&diff=8845
GIT
2026-10-02T19:20:09Z
<p>Boiarino: /* Expert info */</p>
<hr />
<div>We are using 'github' as our online code management. It is owned by Sergey Boyarinov and managed from the site 'github.com' with username boiarino17.<br />
There are repositories: '''coda''', '''clon''', '''epics''', '''parms''' etc.<br />
<br />
<br />
=== Obtaining CODA group drivers ===<br />
<br />
Fedaq repos can be found here: https://code.jlab.org/fedaq/drivers/<br />
<br />
=== Obtaining clas12 online software ===<br />
<br />
git config --global http.proxy jprox.jlab.org:8081<br />
cd /usr/clas12/release<br />
<br />
##git clone --recursive https://github.com/jeffersonlab/clas12-online clas12<br />
<br />
<br />
<br />
For example for version 1.4.0 do following:<br />
<br />
git clone https://github.com/JeffersonLab/clas12-online.git 1.4.0<br />
cd 1.4.0<br />
<br />
Delete all files except .setup. Then type following:<br />
<br />
git clone https://github.com/JeffersonLab/clas12-coda coda<br />
git clone https://github.com/JeffersonLab/clas12-clon clon<br />
git clone https://github.com/JeffersonLab/clas12-parms parms<br />
git clone https://github.com/JeffersonLab/clas12-epics epics<br />
<br />
Goto coda/src/ and type:<br />
<br />
git clone https://github.com/JeffersonLab/vtp.git<br />
cd vtp<br />
git checkout devel-hallb <br />
<br />
Goto $CLON_PARMS and open all files/directories for everybody by typing:<br />
<br />
chmod 777 *<br />
chmod 777 */*<br />
chmod 777 */*/*<br />
.............<br />
<br />
To use that release add following line in the very beginning of your .cshrc:<br />
<br />
setenv CLAS /usr/clas12/release/1.4.0<br />
<br />
=== Obtaining clas12 Trigger project ===<br />
<br />
git clone https://github.com/JeffersonLab/vtp.git<br />
<br />
cd vtp<br />
<br />
git checkout devel-hallb<br />
<br />
=== Obtaining Streaming VTP project ===<br />
<br />
git clone https://github.com/JeffersonLab/jlab-vtp.git<br />
<br />
##cd vtp<br />
<br />
##git checkout devel-hallb<br />
<br />
=== Obtaining clas12 online software - old ===<br />
<br />
git config --global http.proxy jprox.jlab.org:8081<br />
cd <where it suppose to be><br />
<br />
git clone --recursive https://github.com/jeffersonlab/clas12-online clas12<br />
<br />
Include into .cshrc following statements:<br />
<br />
setenv CLAS <where it suppose to be>/clas12<br />
source $CLAS/.setup<br />
<br />
<br />
Compile CODA:<br />
cd $CODA/src<br />
make<br />
<br />
<br />
Compile CODA for other platforms: for example ssh to arm processor and do 'make arm' (see inside Makefile)<br />
<br />
Run mysql server and set coda database using files daq_daq.sql and daq_clasdev.sql (those files were produced by commands<br />
<br />
mysqldump --databases daq_daq -h clondb1 -u clasrun > daq_daq.sql<br />
mysqldump --databases daq_clasdev -h clondb1 -u clasrun > daq_clasdev.sql<br />
<br />
Set MYSQL_HOST env variable to your mysql server (by default it is clondb1)<br />
<br />
=== Expert info ===<br />
<br />
To use it clon clon machines, proxy have to be set by following command:<br />
<br />
git config --global http.proxy jprox.jlab.org:8081<br />
<br />
To create local copy of online software, create directory, go there and copy .setup from existing release. Modify .setup commenting out .setup's form subdirectories you are not going to use. Get needed subdirectories from repository using following commands:<br />
<br />
git clone https://github.com/JeffersonLab/clas12-coda coda<br />
git clone https://github.com/JeffersonLab/clas12-clon clon<br />
git clone https://github.com/JeffersonLab/clas12-parms parms<br />
git clone https://github.com/JeffersonLab/clas12-epics epics<br />
<br />
Command ''git pull'' can be used to get files from repository.<br />
<br />
Use following to add all files locally; 'git status' shows changes, remove files which should not go to git, then execute last two commands:<br />
git status<br />
git add .<br />
git commit -a -m "first commit"<br />
Last command 'git commit' checks everything in locally.<br />
<br />
Removing files/directories example:<br />
git rm src/bosio/bosio.s/SCCS/*<br />
git commit src/bosio/bosio.s/<br />
<br />
'''BEFORE PROCEEDING:''' Make sure you are on 'master' branch. Run 'git branch' to see current branch. If it is not 'master' but <another_branch> and you did some commits already, all your commits were done to <another_branch>. If you did not do commits, '''do it now''', everything will go to <another_branch>. After that, run commands 'git checkout master' and 'git merge <another_branch>'.<br />
<br />
To check everything into repository:<br />
<br />
* git pull<br />
<br />
Make sure there are no conflicts, resolve if any.<br />
<br />
* git push ( do it from clonpc0 as boiarino17 / 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 )<br />
<br />
NOTE: big size file 'src/dac/zzz' was pushed to git causing error; to fix it following was used:<br />
git filter-branch --index-filter "git rm -rf --cached --ignore-unmatch src/dac/zzz" HEAD<br />
rm -rf .git/refs/original/ <br />
git reflog expire --all <br />
git gc --aggressive --prune<br />
git push origin master --force<br />
Three middle commands are not necessary. Seen in one comment, that those 5 commands (or first one ?) can be dangerous !<br />
<br />
=== Viewing Project History ===<br />
<br />
At any point you can view the history of your changes using<br />
<br />
git log<br />
<br />
If you also want to see complete diffs at each step, use<br />
<br />
git log -p<br />
<br />
Often the overview of the change is useful to get a feel of each step<br />
<br />
git log --stat --summary<br />
<br />
<br />
=== Managing Branches ===<br />
<br />
A single Git repository can maintain multiple branches of development. To create a new branch named "mycoda", use<br />
<br />
git branch mycoda<br />
<br />
If you now run<br />
<br />
git branch<br />
<br />
you'll get a list of all existing branches:<br />
<br />
* master<br />
mycoda<br />
<br />
The "mycoda" branch is the one you just created, and the "master" branch is a default branch that was created for you automatically. The asterisk marks the branch you are currently on; type<br />
<br />
git checkout mycoda<br />
<br />
to switch to the experimental branch. Now edit a file, commit the change, and switch back to the master branch:<br />
<br />
(edit file)<br />
git commit -a<br />
git checkout master<br />
<br />
Check that the change you made is no longer visible, since it was made on the experimental branch and you're back on the master branch.<br />
<br />
You can make a different change on the master branch:<br />
<br />
(edit file)<br />
git commit -a<br />
<br />
at this point the two branches have diverged, with different changes made in each. To merge the changes made in ''mycoda'' into ''master'', run<br />
<br />
git merge mycoda<br />
<br />
If the changes don't conflict, you're done. If there are conflicts, markers will be left in the problematic files showing the conflict;<br />
<br />
git diff<br />
<br />
will show this. Once you've edited the files to resolve the conflicts,<br />
<br />
git commit -a<br />
<br />
will commit the result of the merge. Finally,<br />
<br />
gitk<br />
<br />
will show a nice graphical representation of the resulting history.<br />
<br />
At this point you could delete the ''mycoda'' branch with<br />
<br />
git branch -d mycoda<br />
<br />
This command ensures that the changes in the ''mycoda''l branch are already in the current branch.<br />
<br />
If you develop on a branch crazy-idea, then regret it, you can always delete the branch with<br />
<br />
git branch -D crazy-idea<br />
<br />
Branches are cheap and easy, so this is a good way to try something out.<br />
<br />
<br />
=== Using Git For Collaboration ===<br />
<br />
Suppose that Alice has started a new project with a Git repository in /home/alice/project, and that Bob, who has a home directory on the same machine, wants to contribute.<br />
<br />
Bob begins with:<br />
<br />
git clone /home/alice/project myrepo<br />
<br />
This creates a new directory "myrepo" containing a clone of Alice's repository. The clone is on an equal footing with the original project, possessing its own copy of the original project's history.<br />
<br />
Bob then makes some changes and commits them:<br />
<br />
(edit files)<br />
git commit -a<br />
(repeat as necessary)<br />
<br />
When he's ready, he tells Alice to pull changes from the repository at /home/bob/myrepo. She does this with:<br />
<br />
cd /home/alice/project<br />
git pull /home/bob/myrepo master<br />
<br />
This merges the changes from Bob's "master" branch into Alice's current branch. If Alice has made her own changes in the meantime, then she may need to manually fix any conflicts.<br />
<br />
The "pull" command thus performs two operations: it fetches changes from a remote branch, then merges them into the current branch.<br />
<br />
Note that in general, Alice would want her local changes committed before initiating this "pull". If Bob's work conflicts with what Alice did since their histories forked, Alice will use her working tree and the index to resolve conflicts, and existing local changes will interfere with the conflict resolution process (Git will still perform the fetch but will refuse to merge --- Alice will have to get rid of her local changes in some way and pull again when this happens).<br />
<br />
Alice can peek at what Bob did without merging first, using the "fetch" command; this allows Alice to inspect what Bob did, using a special symbol "FETCH_HEAD", in order to determine if he has anything worth pulling, like this:<br />
<br />
git fetch /home/bob/myrepo master<br />
git log -p HEAD..FETCH_HEAD<br />
<br />
This operation is safe even if Alice has uncommitted local changes. The range notation "HEAD..FETCH_HEAD" means "show everything that is reachable from the FETCH_HEAD but exclude anything that is reachable from HEAD". Alice already knows everything that leads to her current state (HEAD), and reviews what Bob has in his state (FETCH_HEAD) that she has not seen with this command.<br />
<br />
If Alice wants to visualize what Bob did since their histories forked she can issue the following command:<br />
<br />
gitk HEAD..FETCH_HEAD<br />
<br />
This uses the same two-dot range notation we saw earlier with git log.<br />
<br />
Alice may want to view what both of them did since they forked. She can use three-dot form instead of the two-dot form:<br />
<br />
gitk HEAD...FETCH_HEAD<br />
<br />
This means "show everything that is reachable from either one, but exclude anything that is reachable from both of them".<br />
<br />
Please note that these range notation can be used with both gitk and "git log".<br />
<br />
After inspecting what Bob did, if there is nothing urgent, Alice may decide to continue working without pulling from Bob. If Bob's history does have something Alice would immediately need, Alice may choose to stash her work-in-progress first, do a "pull", and then finally unstash her work-in-progress on top of the resulting history.<br />
<br />
When you are working in a small closely knit group, it is not unusual to interact with the same repository over and over again. By defining remote repository shorthand, you can make it easier:<br />
<br />
git remote add bob /home/bob/myrepo<br />
<br />
With this, Alice can perform the first part of the "pull" operation alone using the git fetch command without merging them with her own branch, using:<br />
<br />
git fetch bob<br />
<br />
Unlike the longhand form, when Alice fetches from Bob using a remote repository shorthand set up with git remote, what was fetched is stored in a remote-tracking branch, in this case bob/master. So after this:<br />
<br />
git log -p master..bob/master<br />
<br />
shows a list of all the changes that Bob made since he branched from Alice's master branch.<br />
<br />
After examining those changes, Alice could merge the changes into her master branch:<br />
<br />
git merge bob/master<br />
<br />
This merge can also be done by pulling from her own remote-tracking branch, like this:<br />
<br />
git pull . remotes/bob/master<br />
<br />
Note that git pull always merges into the current branch, regardless of what else is given on the command line.<br />
<br />
Later, Bob can update his repo with Alice's latest changes using<br />
<br />
git pull<br />
<br />
Note that he doesn't need to give the path to Alice's repository; when Bob cloned Alice's repository, Git stored the location of her repository in the repository configuration, and that location is used for pulls:<br />
<br />
git config --get remote.origin.url<br />
/home/alice/project<br />
<br />
(The complete configuration created by git clone is visible using git config -l, and the git-config(1) man page explains the meaning of each option.)<br />
<br />
Git also keeps a pristine copy of Alice's master branch under the name "origin/master":<br />
<br />
git branch -r<br />
origin/master<br />
<br />
If Bob later decides to work from a different host, he can still perform clones and pulls using the ssh protocol:<br />
<br />
git clone alice.org:/home/alice/project myrepo<br />
<br />
Alternatively, Git has a native protocol, or can use rsync or http; see git-pull(1) for details.<br />
<br />
Git can also be used in a CVS-like mode, with a central repository that various users push changes to; see git-push(1) and gitcvs-migration(7).<br />
<br />
<br />
=== Useful Commands ===<br />
<br />
If some files were deleted, to delete them from ''master'' do following (NEED CHECK !!!):<br />
<br />
git diff --diff-filter=D --name-only -z | xargs -0 git rm</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=GIT&diff=8844
GIT
2026-09-30T20:03:06Z
<p>Boiarino: /* Expert info */</p>
<hr />
<div>We are using 'github' as our online code management. It is owned by Sergey Boyarinov and managed from the site 'github.com' with username boiarino17.<br />
There are repositories: '''coda''', '''clon''', '''epics''', '''parms''' etc.<br />
<br />
<br />
=== Obtaining CODA group drivers ===<br />
<br />
Fedaq repos can be found here: https://code.jlab.org/fedaq/drivers/<br />
<br />
=== Obtaining clas12 online software ===<br />
<br />
git config --global http.proxy jprox.jlab.org:8081<br />
cd /usr/clas12/release<br />
<br />
##git clone --recursive https://github.com/jeffersonlab/clas12-online clas12<br />
<br />
<br />
<br />
For example for version 1.4.0 do following:<br />
<br />
git clone https://github.com/JeffersonLab/clas12-online.git 1.4.0<br />
cd 1.4.0<br />
<br />
Delete all files except .setup. Then type following:<br />
<br />
git clone https://github.com/JeffersonLab/clas12-coda coda<br />
git clone https://github.com/JeffersonLab/clas12-clon clon<br />
git clone https://github.com/JeffersonLab/clas12-parms parms<br />
git clone https://github.com/JeffersonLab/clas12-epics epics<br />
<br />
Goto coda/src/ and type:<br />
<br />
git clone https://github.com/JeffersonLab/vtp.git<br />
cd vtp<br />
git checkout devel-hallb <br />
<br />
Goto $CLON_PARMS and open all files/directories for everybody by typing:<br />
<br />
chmod 777 *<br />
chmod 777 */*<br />
chmod 777 */*/*<br />
.............<br />
<br />
To use that release add following line in the very beginning of your .cshrc:<br />
<br />
setenv CLAS /usr/clas12/release/1.4.0<br />
<br />
=== Obtaining clas12 Trigger project ===<br />
<br />
git clone https://github.com/JeffersonLab/vtp.git<br />
<br />
cd vtp<br />
<br />
git checkout devel-hallb<br />
<br />
=== Obtaining Streaming VTP project ===<br />
<br />
git clone https://github.com/JeffersonLab/jlab-vtp.git<br />
<br />
##cd vtp<br />
<br />
##git checkout devel-hallb<br />
<br />
=== Obtaining clas12 online software - old ===<br />
<br />
git config --global http.proxy jprox.jlab.org:8081<br />
cd <where it suppose to be><br />
<br />
git clone --recursive https://github.com/jeffersonlab/clas12-online clas12<br />
<br />
Include into .cshrc following statements:<br />
<br />
setenv CLAS <where it suppose to be>/clas12<br />
source $CLAS/.setup<br />
<br />
<br />
Compile CODA:<br />
cd $CODA/src<br />
make<br />
<br />
<br />
Compile CODA for other platforms: for example ssh to arm processor and do 'make arm' (see inside Makefile)<br />
<br />
Run mysql server and set coda database using files daq_daq.sql and daq_clasdev.sql (those files were produced by commands<br />
<br />
mysqldump --databases daq_daq -h clondb1 -u clasrun > daq_daq.sql<br />
mysqldump --databases daq_clasdev -h clondb1 -u clasrun > daq_clasdev.sql<br />
<br />
Set MYSQL_HOST env variable to your mysql server (by default it is clondb1)<br />
<br />
=== Expert info ===<br />
<br />
To use it clon clon machines, proxy have to be set by following command:<br />
<br />
git config --global http.proxy jprox.jlab.org:8081<br />
<br />
To create local copy of online software, create directory, go there and copy .setup from existing release. Modify .setup commenting out .setup's form subdirectories you are not going to use. Get needed subdirectories from repository using following commands:<br />
<br />
git clone https://github.com/JeffersonLab/clas12-coda coda<br />
git clone https://github.com/JeffersonLab/clas12-clon clon<br />
git clone https://github.com/JeffersonLab/clas12-parms parms<br />
git clone https://github.com/JeffersonLab/clas12-epics epics<br />
<br />
Command ''git pull'' can be used to get files from repository.<br />
<br />
Use following to add all files locally; 'git status' shows changes, remove files which should not go to git, then execute last two commands:<br />
git status<br />
git add .<br />
git commit -a -m "first commit"<br />
Last command 'git commit' checks everything in locally.<br />
<br />
Removing files/directories example:<br />
git rm src/bosio/bosio.s/SCCS/*<br />
git commit src/bosio/bosio.s/<br />
<br />
'''BEFORE PROCEEDING:''' Make sure you are on 'master' branch. Run 'git branch' to see current branch. If it is not 'master' but <another_branch> and you did some commits already, all your commits were done to <another_branch>. If you did not do commits, '''do it now''', everything will go to <another_branch>. After that, run commands 'git checkout master' and 'git merge <another_branch>'.<br />
<br />
To check everything into repository:<br />
<br />
* git pull<br />
<br />
Make sure there are no conflicts, resolve if any.<br />
<br />
* git push ( do it from clonpc0 as boiarino17/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 )<br />
<br />
NOTE: big size file 'src/dac/zzz' was pushed to git causing error; to fix it following was used:<br />
git filter-branch --index-filter "git rm -rf --cached --ignore-unmatch src/dac/zzz" HEAD<br />
rm -rf .git/refs/original/ <br />
git reflog expire --all <br />
git gc --aggressive --prune<br />
git push origin master --force<br />
Three middle commands are not necessary. Seen in one comment, that those 5 commands (or first one ?) can be dangerous !<br />
<br />
=== Viewing Project History ===<br />
<br />
At any point you can view the history of your changes using<br />
<br />
git log<br />
<br />
If you also want to see complete diffs at each step, use<br />
<br />
git log -p<br />
<br />
Often the overview of the change is useful to get a feel of each step<br />
<br />
git log --stat --summary<br />
<br />
<br />
=== Managing Branches ===<br />
<br />
A single Git repository can maintain multiple branches of development. To create a new branch named "mycoda", use<br />
<br />
git branch mycoda<br />
<br />
If you now run<br />
<br />
git branch<br />
<br />
you'll get a list of all existing branches:<br />
<br />
* master<br />
mycoda<br />
<br />
The "mycoda" branch is the one you just created, and the "master" branch is a default branch that was created for you automatically. The asterisk marks the branch you are currently on; type<br />
<br />
git checkout mycoda<br />
<br />
to switch to the experimental branch. Now edit a file, commit the change, and switch back to the master branch:<br />
<br />
(edit file)<br />
git commit -a<br />
git checkout master<br />
<br />
Check that the change you made is no longer visible, since it was made on the experimental branch and you're back on the master branch.<br />
<br />
You can make a different change on the master branch:<br />
<br />
(edit file)<br />
git commit -a<br />
<br />
at this point the two branches have diverged, with different changes made in each. To merge the changes made in ''mycoda'' into ''master'', run<br />
<br />
git merge mycoda<br />
<br />
If the changes don't conflict, you're done. If there are conflicts, markers will be left in the problematic files showing the conflict;<br />
<br />
git diff<br />
<br />
will show this. Once you've edited the files to resolve the conflicts,<br />
<br />
git commit -a<br />
<br />
will commit the result of the merge. Finally,<br />
<br />
gitk<br />
<br />
will show a nice graphical representation of the resulting history.<br />
<br />
At this point you could delete the ''mycoda'' branch with<br />
<br />
git branch -d mycoda<br />
<br />
This command ensures that the changes in the ''mycoda''l branch are already in the current branch.<br />
<br />
If you develop on a branch crazy-idea, then regret it, you can always delete the branch with<br />
<br />
git branch -D crazy-idea<br />
<br />
Branches are cheap and easy, so this is a good way to try something out.<br />
<br />
<br />
=== Using Git For Collaboration ===<br />
<br />
Suppose that Alice has started a new project with a Git repository in /home/alice/project, and that Bob, who has a home directory on the same machine, wants to contribute.<br />
<br />
Bob begins with:<br />
<br />
git clone /home/alice/project myrepo<br />
<br />
This creates a new directory "myrepo" containing a clone of Alice's repository. The clone is on an equal footing with the original project, possessing its own copy of the original project's history.<br />
<br />
Bob then makes some changes and commits them:<br />
<br />
(edit files)<br />
git commit -a<br />
(repeat as necessary)<br />
<br />
When he's ready, he tells Alice to pull changes from the repository at /home/bob/myrepo. She does this with:<br />
<br />
cd /home/alice/project<br />
git pull /home/bob/myrepo master<br />
<br />
This merges the changes from Bob's "master" branch into Alice's current branch. If Alice has made her own changes in the meantime, then she may need to manually fix any conflicts.<br />
<br />
The "pull" command thus performs two operations: it fetches changes from a remote branch, then merges them into the current branch.<br />
<br />
Note that in general, Alice would want her local changes committed before initiating this "pull". If Bob's work conflicts with what Alice did since their histories forked, Alice will use her working tree and the index to resolve conflicts, and existing local changes will interfere with the conflict resolution process (Git will still perform the fetch but will refuse to merge --- Alice will have to get rid of her local changes in some way and pull again when this happens).<br />
<br />
Alice can peek at what Bob did without merging first, using the "fetch" command; this allows Alice to inspect what Bob did, using a special symbol "FETCH_HEAD", in order to determine if he has anything worth pulling, like this:<br />
<br />
git fetch /home/bob/myrepo master<br />
git log -p HEAD..FETCH_HEAD<br />
<br />
This operation is safe even if Alice has uncommitted local changes. The range notation "HEAD..FETCH_HEAD" means "show everything that is reachable from the FETCH_HEAD but exclude anything that is reachable from HEAD". Alice already knows everything that leads to her current state (HEAD), and reviews what Bob has in his state (FETCH_HEAD) that she has not seen with this command.<br />
<br />
If Alice wants to visualize what Bob did since their histories forked she can issue the following command:<br />
<br />
gitk HEAD..FETCH_HEAD<br />
<br />
This uses the same two-dot range notation we saw earlier with git log.<br />
<br />
Alice may want to view what both of them did since they forked. She can use three-dot form instead of the two-dot form:<br />
<br />
gitk HEAD...FETCH_HEAD<br />
<br />
This means "show everything that is reachable from either one, but exclude anything that is reachable from both of them".<br />
<br />
Please note that these range notation can be used with both gitk and "git log".<br />
<br />
After inspecting what Bob did, if there is nothing urgent, Alice may decide to continue working without pulling from Bob. If Bob's history does have something Alice would immediately need, Alice may choose to stash her work-in-progress first, do a "pull", and then finally unstash her work-in-progress on top of the resulting history.<br />
<br />
When you are working in a small closely knit group, it is not unusual to interact with the same repository over and over again. By defining remote repository shorthand, you can make it easier:<br />
<br />
git remote add bob /home/bob/myrepo<br />
<br />
With this, Alice can perform the first part of the "pull" operation alone using the git fetch command without merging them with her own branch, using:<br />
<br />
git fetch bob<br />
<br />
Unlike the longhand form, when Alice fetches from Bob using a remote repository shorthand set up with git remote, what was fetched is stored in a remote-tracking branch, in this case bob/master. So after this:<br />
<br />
git log -p master..bob/master<br />
<br />
shows a list of all the changes that Bob made since he branched from Alice's master branch.<br />
<br />
After examining those changes, Alice could merge the changes into her master branch:<br />
<br />
git merge bob/master<br />
<br />
This merge can also be done by pulling from her own remote-tracking branch, like this:<br />
<br />
git pull . remotes/bob/master<br />
<br />
Note that git pull always merges into the current branch, regardless of what else is given on the command line.<br />
<br />
Later, Bob can update his repo with Alice's latest changes using<br />
<br />
git pull<br />
<br />
Note that he doesn't need to give the path to Alice's repository; when Bob cloned Alice's repository, Git stored the location of her repository in the repository configuration, and that location is used for pulls:<br />
<br />
git config --get remote.origin.url<br />
/home/alice/project<br />
<br />
(The complete configuration created by git clone is visible using git config -l, and the git-config(1) man page explains the meaning of each option.)<br />
<br />
Git also keeps a pristine copy of Alice's master branch under the name "origin/master":<br />
<br />
git branch -r<br />
origin/master<br />
<br />
If Bob later decides to work from a different host, he can still perform clones and pulls using the ssh protocol:<br />
<br />
git clone alice.org:/home/alice/project myrepo<br />
<br />
Alternatively, Git has a native protocol, or can use rsync or http; see git-pull(1) for details.<br />
<br />
Git can also be used in a CVS-like mode, with a central repository that various users push changes to; see git-push(1) and gitcvs-migration(7).<br />
<br />
<br />
=== Useful Commands ===<br />
<br />
If some files were deleted, to delete them from ''master'' do following (NEED CHECK !!!):<br />
<br />
git diff --diff-filter=D --name-only -z | xargs -0 git rm</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8843
ATCA
2026-09-25T14:53:17Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm0 (for dpm0-7) or dtm1 (for dpm8-15)) as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/1/0/0 # dpm0<br />
./cob_rce_reset atca1/2/0/0 # dpm8<br />
.......<br />
<br />
<br />
'''DPM's list from dtm0''':<br />
<br />
dpm0:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/1/0/0<br />
dpm1:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/1/0/2<br />
dpm2:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/1/1/0<br />
dpm3:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/1/1/2<br />
dpm4:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/1/2/0<br />
dpm5:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/1/2/2<br />
dpm6:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/1/3/0<br />
dpm7:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/1/3/2<br />
<br />
<br />
'''DPM's list from dtm1''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
setenv gatewayip<br />
setenv ipaddr<br />
setenv serverip<br />
setenv bootfile<br />
setenv hostname<br />
saveenv<br />
<br />
'''IF NEEDED, SET ethaddr THE SAME AS IN JNET, IT IS ALSO HARDCODED IN DHCP SERVER SO ALL 3 HAS TO BE CONSISTENT'''<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8842
ATCA
2026-09-25T14:51:53Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm0 (for dpm0-7) or dtm1 (for dpm8-15)) as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/1/0/0 # dpm0<br />
./cob_rce_reset atca1/2/0/0 # dpm8<br />
.......<br />
<br />
<br />
'''DPM's list from dtm0''':<br />
<br />
dpm0:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/1/0/0<br />
dpm1:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/1/0/2<br />
dpm2:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/1/1/0<br />
dpm3:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/1/1/2<br />
dpm4:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/1/2/0<br />
dpm5:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/1/2/2<br />
dpm6:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/1/3/0<br />
dpm7:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/1/3/2<br />
<br />
<br />
'''DPM's list from dtm1''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
setenv gatewayip<br />
setenv ipaddr<br />
setenv serverip<br />
setenv bootfile<br />
saveenv<br />
<br />
'''IF NEEDED, SET ethaddr THE SAME AS IN JNET, IT IS ALSO HARDCODED IN DHCP SERVER SO ALL 3 HAS TO BE CONSISTENT'''<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8841
ATCA
2026-09-25T14:32:42Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm0 (for dpm0-7) or dtm1 (for dpm8-15)) as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/1/0/0 # dpm0<br />
./cob_rce_reset atca1/2/0/0 # dpm8<br />
.......<br />
<br />
<br />
'''DPM's list from dtm0''':<br />
<br />
dpm0:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/1/0/0<br />
dpm1:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/1/0/2<br />
dpm2:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/1/1/0<br />
dpm3:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/1/1/2<br />
dpm4:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/1/2/0<br />
dpm5:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/1/2/2<br />
dpm6:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/1/3/0<br />
dpm7:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/1/3/2<br />
<br />
<br />
'''DPM's list from dtm1''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
setenv gatewayip<br />
setenv ipaddr<br />
setenv serverip<br />
saveenv<br />
<br />
'''IF NEEDED, SET ethaddr THE SAME AS IN JNET, IT IS ALSO HARDCODED IN DHCP SERVER SO ALL 3 HAS TO BE CONSISTENT'''<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8840
ATCA
2026-09-25T14:26:37Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
setenv gatewayip<br />
setenv ipaddr<br />
setenv serverip<br />
saveenv<br />
<br />
'''IF NEEDED, SET ethaddr THE SAME AS IN JNET, IT IS ALSO HARDCODED IN DHCP SERVER SO ALL 3 HAS TO BE CONSISTENT'''<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8839
ATCA
2026-09-24T21:06:26Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
setenv gatewayip<br />
setenv ipaddr<br />
setenv serverip<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8838
ATCA
2026-09-24T21:05:47Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
setenv gatewayip<br />
setenv ipaddr<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8837
ATCA
2026-09-24T20:57:49Z
<p>Boiarino: /* DTMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8836
ATCA
2026-09-24T20:56:59Z
<p>Boiarino: /* DTMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
setenv dnsip '129.57.90.255'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8835
ATCA
2026-09-24T20:50:43Z
<p>Boiarino: /* DTMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8834
ATCA
2026-09-24T20:50:13Z
<p>Boiarino: /* DTMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* to convert old bootloader to tye new one:<br />
<br />
<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=JLAB_TI&diff=8833
JLAB TI
2026-09-22T19:19:39Z
<p>Boiarino: </p>
<hr />
<div>There are several TI (Trigger Interface) cards: [[JLAB PCI TI]] in PCI format, [[JLAB VME TI]] in VME format, [[JLAB VME TID]] new version in VME/VXS format.<br />
<br />
Data format can be found in [[JLAB TS]]</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=JLAB_TI&diff=8832
JLAB TI
2026-09-22T19:19:21Z
<p>Boiarino: </p>
<hr />
<div>There are several TI (Trigger Interface) cards: [[JLAB PCI TI]] in PCI format, [[JLAB VME TI]] in VME format, [[JLAB VME TID]] new version in VME/VXS format.<br />
<br />
Data format can be found [[JLAB TS]] here.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8831
CUDA
2026-09-15T18:52:15Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website https://developer.nvidia.com/cuda-downloads. Click Linux -> x86_64 -> RHEL -> 9 -> rpm(network). Follow instructions, for example:<br />
<br />
dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64/cuda-rhel9.repo<br />
dnf clean all<br />
dnf -y install cuda-toolkit-13-4<br />
<br />
Check that repo is enabled (if not, see notices in [[yum]]):<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
Install:<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
CUDA should be installed in ''/usr/local/cuda-13.4'' directory. Users should include following in .cshrc:<br />
<br />
setenv CUDA /usr/local/cuda-13.4<br />
setenv PATH ${PATH}:${CUDA}/bin<br />
setenv LD_LIBRARY_PATH "$LD_LIBRARY_PATH":$CUDA/lib64<br />
<br />
<br />
Reboot machine.<br />
<br />
Check installation:<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+<br />
<br />
<br />
Compile following test program by command ''nvcc cudatest.cu -o cudatest'':<br />
<br />
/* cudatest.cu */<br />
<br />
#include <iostream><br />
#include <cstdio><br />
<br />
// A tiny GPU kernel that actually prints from the GPU<br />
__global__ void helloFromGPU() {<br />
// Only let the very first thread print to avoid flooding the console<br />
if (threadIdx.x == 0 && blockIdx.x == 0) {<br />
printf("Hello World from the GPU!\n");<br />
}<br />
}<br />
<br />
int main() {<br />
std::cout << "[1] Program started on CPU..." << std::endl;<br />
<br />
// Check if a CUDA-capable GPU is even visible<br />
int deviceCount = 0;<br />
cudaError_t err = cudaGetDeviceCount(&deviceCount);<br />
<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ CUDA Error: " << cudaGetErrorString(err) << std::endl;<br />
std::cout << "Reason: Your system might lack an NVIDIA GPU, or drivers are missing." << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[2] Found " << deviceCount << " CUDA-capable GPU(s)." << std::endl;<br />
<br />
// Launch 1 block with 1 thread<br />
std::cout << "[3] Launching GPU kernel..." << std::endl;<br />
helloFromGPU<<<1, 1>>>();<br />
<br />
// Check if the kernel launch itself failed<br />
err = cudaGetLastError();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Kernel Launch Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
// Force CPU to wait and flush the GPU's printf buffer<br />
err = cudaDeviceSynchronize();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Synchronization Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[4] Program finished successfully on CPU." << std::endl;<br />
return 0;<br />
}<br />
<br />
<br />
Run it:<br />
<br />
clonfarm11:boiarino> ./cudatest <br />
[1] Program started on CPU...<br />
[2] Found 2 CUDA-capable GPU(s).<br />
[3] Launching GPU kernel...<br />
Hello World from the GPU!<br />
[4] Program finished successfully on CPU.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8830
CUDA
2026-09-15T18:49:28Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website https://developer.nvidia.com/cuda-downloads. Click Linux -> x86_64 -> RHEL -> 9 -> rpm(network). Follow instructions, for example:<br />
<br />
dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64/cuda-rhel9.repo<br />
dnf clean all<br />
dnf -y install cuda-toolkit-13-4<br />
<br />
Check that repo is enabled (if not, see notices in [[yum]]):<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
Install:<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
Reboot machine.<br />
<br />
Check installation:<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+<br />
<br />
<br />
Compile following test program by command ''nvcc cudatest.cu -o cudatest'':<br />
<br />
/* cudatest.cu */<br />
<br />
#include <iostream><br />
#include <cstdio><br />
<br />
// A tiny GPU kernel that actually prints from the GPU<br />
__global__ void helloFromGPU() {<br />
// Only let the very first thread print to avoid flooding the console<br />
if (threadIdx.x == 0 && blockIdx.x == 0) {<br />
printf("Hello World from the GPU!\n");<br />
}<br />
}<br />
<br />
int main() {<br />
std::cout << "[1] Program started on CPU..." << std::endl;<br />
<br />
// Check if a CUDA-capable GPU is even visible<br />
int deviceCount = 0;<br />
cudaError_t err = cudaGetDeviceCount(&deviceCount);<br />
<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ CUDA Error: " << cudaGetErrorString(err) << std::endl;<br />
std::cout << "Reason: Your system might lack an NVIDIA GPU, or drivers are missing." << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[2] Found " << deviceCount << " CUDA-capable GPU(s)." << std::endl;<br />
<br />
// Launch 1 block with 1 thread<br />
std::cout << "[3] Launching GPU kernel..." << std::endl;<br />
helloFromGPU<<<1, 1>>>();<br />
<br />
// Check if the kernel launch itself failed<br />
err = cudaGetLastError();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Kernel Launch Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
// Force CPU to wait and flush the GPU's printf buffer<br />
err = cudaDeviceSynchronize();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Synchronization Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[4] Program finished successfully on CPU." << std::endl;<br />
return 0;<br />
}<br />
<br />
<br />
Run it:<br />
<br />
clonfarm11:boiarino> ./cudatest <br />
[1] Program started on CPU...<br />
[2] Found 2 CUDA-capable GPU(s).<br />
[3] Launching GPU kernel...<br />
Hello World from the GPU!<br />
[4] Program finished successfully on CPU.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8829
CUDA
2026-09-15T18:44:08Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website https://developer.nvidia.com/cuda-downloads. Click Linux -> x86_64 -> RHEL -> 9 -> rpm(network). Follow instructions, for example:<br />
<br />
dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64/cuda-rhel9.repo<br />
dnf clean all<br />
dnf -y install cuda-toolkit-13-4<br />
<br />
Check that repo is enabled (if not, see notices in [[yum]]):<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
Install:<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+<br />
<br />
<br />
Compile following test program by command ''nvcc cudatest.cu -o cudatest'':<br />
<br />
/* cudatest.cu */<br />
<br />
#include <iostream><br />
#include <cstdio><br />
<br />
// A tiny GPU kernel that actually prints from the GPU<br />
__global__ void helloFromGPU() {<br />
// Only let the very first thread print to avoid flooding the console<br />
if (threadIdx.x == 0 && blockIdx.x == 0) {<br />
printf("Hello World from the GPU!\n");<br />
}<br />
}<br />
<br />
int main() {<br />
std::cout << "[1] Program started on CPU..." << std::endl;<br />
<br />
// Check if a CUDA-capable GPU is even visible<br />
int deviceCount = 0;<br />
cudaError_t err = cudaGetDeviceCount(&deviceCount);<br />
<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ CUDA Error: " << cudaGetErrorString(err) << std::endl;<br />
std::cout << "Reason: Your system might lack an NVIDIA GPU, or drivers are missing." << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[2] Found " << deviceCount << " CUDA-capable GPU(s)." << std::endl;<br />
<br />
// Launch 1 block with 1 thread<br />
std::cout << "[3] Launching GPU kernel..." << std::endl;<br />
helloFromGPU<<<1, 1>>>();<br />
<br />
// Check if the kernel launch itself failed<br />
err = cudaGetLastError();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Kernel Launch Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
// Force CPU to wait and flush the GPU's printf buffer<br />
err = cudaDeviceSynchronize();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Synchronization Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[4] Program finished successfully on CPU." << std::endl;<br />
return 0;<br />
}<br />
<br />
<br />
Run it:<br />
<br />
clonfarm11:boiarino> ./cudatest <br />
[1] Program started on CPU...<br />
[2] Found 2 CUDA-capable GPU(s).<br />
[3] Launching GPU kernel...<br />
Hello World from the GPU!<br />
[4] Program finished successfully on CPU.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8828
CUDA
2026-09-15T18:36:50Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website:<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
Install:<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+<br />
<br />
<br />
Compile following test program by command ''nvcc cudatest.cu -o cudatest'':<br />
<br />
/* cudatest.cu */<br />
<br />
#include <iostream><br />
#include <cstdio><br />
<br />
// A tiny GPU kernel that actually prints from the GPU<br />
__global__ void helloFromGPU() {<br />
// Only let the very first thread print to avoid flooding the console<br />
if (threadIdx.x == 0 && blockIdx.x == 0) {<br />
printf("Hello World from the GPU!\n");<br />
}<br />
}<br />
<br />
int main() {<br />
std::cout << "[1] Program started on CPU..." << std::endl;<br />
<br />
// Check if a CUDA-capable GPU is even visible<br />
int deviceCount = 0;<br />
cudaError_t err = cudaGetDeviceCount(&deviceCount);<br />
<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ CUDA Error: " << cudaGetErrorString(err) << std::endl;<br />
std::cout << "Reason: Your system might lack an NVIDIA GPU, or drivers are missing." << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[2] Found " << deviceCount << " CUDA-capable GPU(s)." << std::endl;<br />
<br />
// Launch 1 block with 1 thread<br />
std::cout << "[3] Launching GPU kernel..." << std::endl;<br />
helloFromGPU<<<1, 1>>>();<br />
<br />
// Check if the kernel launch itself failed<br />
err = cudaGetLastError();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Kernel Launch Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
// Force CPU to wait and flush the GPU's printf buffer<br />
err = cudaDeviceSynchronize();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Synchronization Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[4] Program finished successfully on CPU." << std::endl;<br />
return 0;<br />
}<br />
<br />
<br />
Run it:<br />
<br />
clonfarm11:boiarino> ./cudatest <br />
[1] Program started on CPU...<br />
[2] Found 2 CUDA-capable GPU(s).<br />
[3] Launching GPU kernel...<br />
Hello World from the GPU!<br />
[4] Program finished successfully on CPU.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8827
CUDA
2026-09-15T18:36:18Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website ! Than, install:<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+<br />
<br />
<br />
Compile following test program by command ''nvcc cudatest.cu -o cudatest'':<br />
<br />
/* cudatest.cu */<br />
<br />
#include <iostream><br />
#include <cstdio><br />
<br />
// A tiny GPU kernel that actually prints from the GPU<br />
__global__ void helloFromGPU() {<br />
// Only let the very first thread print to avoid flooding the console<br />
if (threadIdx.x == 0 && blockIdx.x == 0) {<br />
printf("Hello World from the GPU!\n");<br />
}<br />
}<br />
<br />
int main() {<br />
std::cout << "[1] Program started on CPU..." << std::endl;<br />
<br />
// Check if a CUDA-capable GPU is even visible<br />
int deviceCount = 0;<br />
cudaError_t err = cudaGetDeviceCount(&deviceCount);<br />
<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ CUDA Error: " << cudaGetErrorString(err) << std::endl;<br />
std::cout << "Reason: Your system might lack an NVIDIA GPU, or drivers are missing." << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[2] Found " << deviceCount << " CUDA-capable GPU(s)." << std::endl;<br />
<br />
// Launch 1 block with 1 thread<br />
std::cout << "[3] Launching GPU kernel..." << std::endl;<br />
helloFromGPU<<<1, 1>>>();<br />
<br />
// Check if the kernel launch itself failed<br />
err = cudaGetLastError();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Kernel Launch Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
// Force CPU to wait and flush the GPU's printf buffer<br />
err = cudaDeviceSynchronize();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Synchronization Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[4] Program finished successfully on CPU." << std::endl;<br />
return 0;<br />
}<br />
<br />
<br />
Run it:<br />
<br />
clonfarm11:boiarino> ./cudatest <br />
[1] Program started on CPU...<br />
[2] Found 2 CUDA-capable GPU(s).<br />
[3] Launching GPU kernel...<br />
Hello World from the GPU!<br />
[4] Program finished successfully on CPU.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8826
CUDA
2026-09-15T18:34:45Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website ! Than, install:<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+<br />
<br />
<br />
'''Compile following test program by ''nvcc cudatest.cu -o cudatest'' and run it'''<br />
<br />
/* cudatest.cu */<br />
<br />
#include <iostream><br />
#include <cstdio><br />
<br />
// A tiny GPU kernel that actually prints from the GPU<br />
__global__ void helloFromGPU() {<br />
// Only let the very first thread print to avoid flooding the console<br />
if (threadIdx.x == 0 && blockIdx.x == 0) {<br />
printf("Hello World from the GPU!\n");<br />
}<br />
}<br />
<br />
int main() {<br />
std::cout << "[1] Program started on CPU..." << std::endl;<br />
<br />
// Check if a CUDA-capable GPU is even visible<br />
int deviceCount = 0;<br />
cudaError_t err = cudaGetDeviceCount(&deviceCount);<br />
<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ CUDA Error: " << cudaGetErrorString(err) << std::endl;<br />
std::cout << "Reason: Your system might lack an NVIDIA GPU, or drivers are missing." << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[2] Found " << deviceCount << " CUDA-capable GPU(s)." << std::endl;<br />
<br />
// Launch 1 block with 1 thread<br />
std::cout << "[3] Launching GPU kernel..." << std::endl;<br />
helloFromGPU<<<1, 1>>>();<br />
<br />
// Check if the kernel launch itself failed<br />
err = cudaGetLastError();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Kernel Launch Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
// Force CPU to wait and flush the GPU's printf buffer<br />
err = cudaDeviceSynchronize();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Synchronization Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[4] Program finished successfully on CPU." << std::endl;<br />
return 0;<br />
}</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8825
CUDA
2026-09-15T18:33:37Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website ! Than, install:<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+<br />
<br />
<br />
'''Compile and run test program'''<br />
<br />
/* cudatest.cu */<br />
<br />
#include <iostream><br />
#include <cstdio><br />
<br />
// A tiny GPU kernel that actually prints from the GPU<br />
__global__ void helloFromGPU() {<br />
// Only let the very first thread print to avoid flooding the console<br />
if (threadIdx.x == 0 && blockIdx.x == 0) {<br />
printf("Hello World from the GPU!\n");<br />
}<br />
}<br />
<br />
int main() {<br />
std::cout << "[1] Program started on CPU..." << std::endl;<br />
<br />
// Check if a CUDA-capable GPU is even visible<br />
int deviceCount = 0;<br />
cudaError_t err = cudaGetDeviceCount(&deviceCount);<br />
<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ CUDA Error: " << cudaGetErrorString(err) << std::endl;<br />
std::cout << "Reason: Your system might lack an NVIDIA GPU, or drivers are missing." << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[2] Found " << deviceCount << " CUDA-capable GPU(s)." << std::endl;<br />
<br />
// Launch 1 block with 1 thread<br />
std::cout << "[3] Launching GPU kernel..." << std::endl;<br />
helloFromGPU<<<1, 1>>>();<br />
<br />
// Check if the kernel launch itself failed<br />
err = cudaGetLastError();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Kernel Launch Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
// Force CPU to wait and flush the GPU's printf buffer<br />
err = cudaDeviceSynchronize();<br />
if (err != cudaSuccess) {<br />
std::cout << "❌ Synchronization Error: " << cudaGetErrorString(err) << std::endl;<br />
return 1;<br />
}<br />
<br />
std::cout << "[4] Program finished successfully on CPU." << std::endl;<br />
return 0;<br />
}</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8824
CUDA
2026-09-15T18:30:29Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website ! Than, install:<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8823
CUDA
2026-09-15T18:30:11Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
'''Find installed cards:'''<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
'''Install software:'''<br />
<br />
Disable jlab/rhel repo with cuda first, and get cuda repo from nvidia website !<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8822
CUDA
2026-09-15T18:27:50Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
Find installed cards:<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
Install software:<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
dnf install cuda<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8821
CUDA
2026-09-15T18:27:15Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
Find installed cards:<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
Install software:<br />
<br />
[root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
[root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09<br />
<br />
[root@clonfarm11 ~]# nvidia-smi<br />
Tue Sep 15 14:26:10 2026 <br />
+-----------------------------------------------------------------------------------------+<br />
| NVIDIA-SMI 615.71.09 KMD Version: 615.71.09 CUDA UMD Version: 13.4 |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |<br />
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |<br />
| | | MIG M. |<br />
|=========================================+========================+======================|<br />
| 0 Tesla T4 Off | 00000000:2C:00.0 Off | 0 |<br />
| N/A 31C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
| 1 Tesla T4 Off | 00000000:31:00.0 Off | 0 |<br />
| N/A 30C P8 9W / 70W | 0MiB / 15360MiB | 0% Default |<br />
| | | N/A |<br />
+-----------------------------------------+------------------------+----------------------+<br />
<br />
+-----------------------------------------------------------------------------------------+<br />
| Processes: |<br />
| GPU GI CI PID Type Process name GPU Memory |<br />
| ID ID Usage |<br />
|=========================================================================================|<br />
| No running processes found |<br />
+-----------------------------------------------------------------------------------------+</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8820
CUDA
2026-09-15T18:26:00Z
<p>Boiarino: </p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
Find installed cards:<br />
<br />
[root@clonfarm11 ~]# lspci | grep -i nvidia<br />
2c:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
31:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)<br />
<br />
Install software:<br />
<br />
root@clonfarm11 ~]# yum repolist all<br />
.....<br />
cuda-rhel9-x86_64 cuda-rhel9-x86_64 enabled<br />
.....<br />
<br />
dnf install nvidia-driver<br />
dnf install nvidia-driver-cuda<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CUDA&diff=8819
CUDA
2026-09-15T18:22:27Z
<p>Boiarino: Created page with "Some notes for RHEL9.8 on clonfarm11: [root@clonfarm11 ~]# ls /usr/src | grep nvidia nvidia-615.71.09 root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09"</p>
<hr />
<div>Some notes for RHEL9.8 on clonfarm11:<br />
<br />
[root@clonfarm11 ~]# ls /usr/src | grep nvidia<br />
nvidia-615.71.09<br />
<br />
root@clonfarm11 ~]# dkms install -m nvidia -v 615.71.09</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=CLON_Index&diff=8818
CLON Index
2026-09-15T18:21:09Z
<p>Boiarino: </p>
<hr />
<div>[[Abaco XVB603]]<br />
<br />
[[ActiveMQ]]<br />
<br />
[[akcp]] temperature/humidity etc sensors<br />
<br />
[[Apache]]<br />
<br />
[[archlinux]]<br />
<br />
[[ATCA]] from SLAC<br />
<br />
[[automounts]]<br />
<br />
[[Bertan MWPC]] High Voltage Power Supplies<br />
<br />
[[Bootp]]<br />
<br />
[[BOSIO]]<br />
<br />
[[Cacti]]<br />
<br />
[[CAEN A464]] caenet board (installed in sy527 mainframes)<br />
<br />
[[CAEN A1535]] HV board<br />
<br />
[[CAEN A1733 A1833]] 12/28 ch. 3kV/3mA, 4kV/2mA High Voltage Boards ( SY1527 / SY2527 / SY3527 Universal Multichannel System )<br />
<br />
[[CAEN A1932A]] 48 ch. 3kV 500uA High Voltage Board ( SY1527 / SY2527 / SY3527 Universal Multichannel System )<br />
<br />
[[CAEN A509H-L00]] 15 ch. 8V 500mA Low Voltage Board ( SY527 Universal Multichannel System )<br />
<br />
[[CAEN C111C CAMAC Controller]]<br />
<br />
[[CAEN SY1527 Mainframe]]<br />
<br />
[[CAEN SY4527 Mainframe]]<br />
<br />
[[CAEN SY527 Mainframe]] and modules<br />
<br />
[[CAEN V1190]] TDC board (128 ch 100 ps)<br />
<br />
[[CAEN V1290]] TDC board (32 ch 25 ps)<br />
<br />
[[CAEN V1495]] General Purpose VME Board<br />
<br />
[[CAEN V1720]] Flash ADC VME Board<br />
<br />
[[CAEN V288]]<br />
<br />
[[CAEN V560]] scaler board<br />
<br />
[[CAEN V775]] TDC Board<br />
<br />
[[CAEN V792]] ADC Board<br />
<br />
[[CAEN V895]] 16 ch. Leading Edge Discriminator with individual thresholds<br />
<br />
[[Capfast]]<br />
<br />
[[CCDB]]<br />
<br />
[[Cernlib]]<br />
<br />
[[Cisco Switches]]<br />
<br />
[[Clasweb]]<br />
<br />
[[Clasxt]]<br />
<br />
[[Clon00]]<br />
<br />
[[Clon01]]<br />
<br />
[[Clon02]]<br />
<br />
[[Clon03]]<br />
<br />
[[Clon04]]<br />
<br />
[[Clon05]]<br />
<br />
[[Clon06]]<br />
<br />
[[Clondaq1]]<br />
<br />
[[Clondaq2]]<br />
<br />
[[Clondaq7]]<br />
<br />
[[Clondb1]]<br />
<br />
[[Clondb2]]<br />
<br />
[[Clondb3]]<br />
<br />
[[Clonfs]] OBSOLETE Main RAID System<br />
<br />
[[Clonfs1]] now clonfs1a-old<br />
<br />
[[Clonfs2]] OBSOLETE<br />
<br />
[[clonhp]]<br />
<br />
[[clonhp2]]<br />
<br />
[[Clonmon]]<br />
<br />
[[Clonmon0]]<br />
<br />
[[Clonmon1]]<br />
<br />
[[Clonmon2]]<br />
<br />
[[Clonpc1]]<br />
<br />
[[Clonpc2]]<br />
<br />
[[Clonpc3]]<br />
<br />
[[Clonpc5]]<br />
<br />
[[Clonpc6]]<br />
<br />
[[Clonpc8]]<br />
<br />
[[Clontrig0]]<br />
<br />
[[Clonusr1]]<br />
<br />
[[Clonusr2]]<br />
<br />
[[Clonusr3]]<br />
<br />
[[Clonweb]]<br />
<br />
[[Clonwiki]]<br />
<br />
[[CMON]]<br />
<br />
[[Coda]]<br />
<br />
[[Codaedit]]<br />
<br />
[[Compcontrol CC121]]<br />
<br />
[[Concurrent VME controllers]]<br />
<br />
[[CUDA]]<br />
<br />
[[CycladesTS1000]]<br />
<br />
[[DATEL DVME-628]]<br />
<br />
[[DHCP server]]<br />
<br />
[[DNS server]]<br />
<br />
[[Electronics Documentation]]<br />
<br />
[[Emacs]]<br />
<br />
[[EtherLite32]]<br />
<br />
[[EPICS Base Installation]]<br />
<br />
[[EPICS HALLB Installation]]<br />
<br />
[[EPICS: Generation of IOC with different options and customization for HallB]]<br />
<br />
[[EPICS: Software IOC]]<br />
<br />
[[EPICS: vxWorks IOC]]<br />
<br />
[[EPICS: Software IOC for CAEN HV]]<br />
<br />
[[EPICS: IOC for MPOD]]<br />
<br />
[[EPICS: generation of DBs and GUIs for HV]]<br />
<br />
[[EPICS: CVS usage examples]]<br />
<br />
[[EPICS: Timeline Histories]]<br />
<br />
[[EPICS: Gamma Profiler]]<br />
<br />
[[EPICS: EDM compilation and configuration]]<br />
<br />
[[EPICS: HV : ADDING CRATES]]<br />
<br />
[[EPICS: SCALER : ADDING CRATES]]<br />
<br />
[[EPICS: SVT]]<br />
<br />
[[ET system]] event transfer system package - part of CODA DAQ system<br />
<br />
[[Event Monitor]]<br />
<br />
[[EVIO]]<br />
<br />
[[fdisk]]<br />
<br />
[[Fiber Channel Switches]]<br />
<br />
[[FieldPoint]]<br />
<br />
[[Flash ADC Studies]]<br />
<br />
[[Foundry BigIron 15000 Switch]]<br />
<br />
[[Foundry Switches]]<br />
<br />
[[GANELEC CFD FCC8]] Constant Fraction Discriminator<br />
<br />
[[GCC]]<br />
<br />
[[GE XVB601]] VME controller<br />
<br />
[[GIT]] repository<br />
<br />
[[Gnome]]<br />
<br />
[[Helicity Signals from MCC]]<br />
<br />
[[Highland V450]]<br />
<br />
[[Highland V851]]<br />
<br />
[[HTML Help]]<br />
<br />
[[HYTEC VSD2992]]<br />
<br />
[[Java]]<br />
<br />
[[JAVA installation]] - old solaris information<br />
<br />
[[JInventory]]<br />
<br />
[[JLAB DCRB]] drift chamber readout board<br />
<br />
[[JLAB Discriminators]]<br />
<br />
[[JLAB FANIO]] VME TDC FanIO board for v1190/v1290 CAEN TDCs<br />
<br />
[[JLAB FADC250]]<br />
<br />
[[JLAB FLEXIO]]<br />
<br />
[[JLAB LF]] VME Latch FIFO Board<br />
<br />
[[JLAB LD]] VME Latch Driver Board<br />
<br />
[[JLAB Level2 Majority]] Logic Unit<br />
<br />
[[JLAB MLU]] VME Memory Lookup Unit (MLU)<br />
<br />
[[JLAB MO]] VME Master Oscillator Distribution module<br />
<br />
[[JLAB OR]] VME Programmable “OR” Module<br />
<br />
[[JLAB SD]] VXS Signal Distribution Module<br />
<br />
[[JLAB SSP]] VXS Sub System Processor<br />
<br />
[[JLAB TS2]] VXI D-size Trigger Supervisor Module<br />
<br />
[[JLAB TS]] CODA Trigger Supervisor Module<br />
<br />
[[JLAB TI]] CODA Trigger Interface Module<br />
<br />
[[JLAB TD]] CODA Trigger Distribution Module<br />
<br />
[[JLAB PCI TI]] PCI Trigger Interface Card<br />
<br />
[[JLAB VME TI]] VME Trigger Interface Module<br />
<br />
[[JLAB VME TID]] New VME/VXS Trigger Interface Module<br />
<br />
[[JLAB VME VSCM]] New SVT Readout Module<br />
<br />
[[JLAB VMM3]] VMM3-based Readout Module<br />
<br />
[[Joerger VSC16]]<br />
<br />
[[Ipc]] Hall B interprocess communication<br />
<br />
[[Iptables]]<br />
<br />
[[KineticSystems 2917]]<br />
<br />
[[Labeling Machines]]<br />
<br />
[[Linux Installation Procedure]]<br />
<br />
[[Linux Customization on CLON Cluster]]<br />
<br />
[[Linux Boot Server]] for VME diskless controllers<br />
<br />
[[Linux Tricks]]<br />
<br />
[[Lnf cluster]]<br />
<br />
[[Mac OS X Installation Procedure]]<br />
<br />
[[maven]]<br />
<br />
[[Mellanox]]<br />
<br />
[[Motorola MVME230x]]<br />
<br />
[[Motorola MVME5500]]<br />
<br />
[[Move2silo]]<br />
<br />
[[MPD]] VME readout board<br />
<br />
[[MRTG]]<br />
<br />
[[mSQL]]<br />
<br />
[[MYA]]<br />
<br />
[[MySQL Installation]]<br />
<br />
[[MySQL Usage]]<br />
<br />
[[Nagios]]<br />
<br />
[[Nagios Plugins]]<br />
<br />
[[Net-SNMP]]<br />
<br />
[[Network]]<br />
<br />
[[NFS]]<br />
<br />
[[NIS server]]<br />
<br />
[[Nrpe]]<br />
<br />
[[Ntp]]<br />
<br />
[[OMS VME44]] by Oregon Micro Systems<br />
<br />
[[OMS VS4]] by Oregon Micro Systems<br />
<br />
[[OpenSSL]]<br />
<br />
[[PERL]]<br />
<br />
[[PHP Help]]<br />
<br />
[[Power Strips]]<br />
<br />
[[Procmail]]<br />
<br />
[[Proxy]]<br />
<br />
[[PrPMC]]<br />
<br />
[[Qt installation]]<br />
<br />
[[QtDM]]<br />
<br />
[[QtDM patches]]<br />
<br />
[[QtEpics or EpicsQt]]<br />
<br />
[[Qt New Project ]]<br />
<br />
[[raid]]<br />
<br />
[[raidold]]<br />
<br />
[[ramdisk]]<br />
<br />
[[RCDB]]<br />
<br />
[[ROOT]] CERN ROOT package<br />
<br />
[[Routing]]<br />
<br />
[[Rrdtool]]<br />
<br />
[[Runcontrol]]<br />
<br />
[[Sampa]]<br />
<br />
[[SBS VIPC616]]<br />
<br />
[[Scons]]<br />
<br />
[[Serial Connections from Computer Ports]]<br />
<br />
[[Sfs61]]<br />
<br />
[[SILO]]<br />
<br />
[[SLAC]]<br />
<br />
[[Slow Controls Time History]]<br />
<br />
[[SmartSockets]]<br />
<br />
[[SNMP]]<br />
<br />
[[Software Documentation]]<br />
<br />
[[Solaris Installation Procedure]]<br />
<br />
[[Solaris Customization on CLON Cluster]]<br />
<br />
[[Solaris Patches]]<br />
<br />
[[SSH]]<br />
<br />
[[Streaming]]<br />
<br />
[[Struck SIS3801]]<br />
<br />
[[Sudo]]<br />
<br />
[[SUN Microsystems]]<br />
<br />
[[Systemd]]<br />
<br />
[[SYSTRAN VMESC5]]<br />
<br />
[[SMI++]]<br />
<br />
[[Tcl/Tk]]<br />
<br />
[[Tftp]]<br />
<br />
[[Tftpboot]]<br />
<br />
[[Trigger system for CLAS]] v1495-based version<br />
<br />
[[Troubleshooting printing]]<br />
<br />
[[Tsi148]] VME Tempe controller<br />
<br />
[[Universe II]] VME controller<br />
<br />
[[UNIX Automount on CLON Cluster]]<br />
<br />
[[UPS (Uninterruptible Power Supplies)]]<br />
<br />
[[UPS hallb-ch-ups]]<br />
<br />
[[UPS CHB1]]<br />
<br />
[[UPS CHB2]]<br />
<br />
[[UPS Troubleshooting]]<br />
<br />
[[VHDL programming]]<br />
<br />
[[VI editor]]<br />
<br />
[[Vivado]]<br />
<br />
[[VMIC VMIVME-3122]]<br />
<br />
[[VMIC VMIVME-2120]]<br />
<br />
[[VMIC VMIVME-1129]]<br />
<br />
[[VMIC VMIVME-2232]]<br />
<br />
[[VMIC VMIVME-6015]]<br />
<br />
[[VMIC VMIVME-6016]]<br />
<br />
[[VMM3]]<br />
<br />
[[VME]] JVME Driver installation, DiagGuiServer setting on boot, etc<br />
<br />
[[VNC]]<br />
<br />
[[VTP]]<br />
<br />
[[WIENER]]<br />
<br />
[[Wiki]]<br />
<br />
[[Wiring]]<br />
<br />
[[VxWorks]]<br />
<br />
[[X server]]<br />
<br />
[[Xilinx]]<br />
<br />
[[Xycom DIO XVME-240]]<br />
<br />
[[Xycom XVME-564]]<br />
<br />
[[Xycom XVME-560]]<br />
<br />
[[Yum]]<br />
<br />
[[Zedboard]]<br />
<br />
[[ZFS]]</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=Yum&diff=8817
Yum
2026-09-15T18:12:30Z
<p>Boiarino: /* yum/dnf at jlab */</p>
<hr />
<div>== yum/dnf at jlab ==<br />
<br />
'''NOTE:''' file ''/etc/dnf/plugins/subscription-manager.conf'' contains by default line ''disable_system_repos=1'', '''which makes all repositories defined outside redhat.repo to be disabled'''<br />
<br />
To add repo's:<br />
<br />
subscription-manager repos --enable <repo_id><br />
<br />
<br />
In particular, following have to be enabled to get nload, xpdf, python-alembic, tix, itcl, itk etc:<br />
<br />
subscription-manager repos --enable JLab_EPEL_EPEL_7<br />
subscription-manager repos --enable rhel-7-workstation-optional-rpms<br />
<br />
Repo ID's can be obtained by:<br />
<br />
subscription-manager repos --list<br />
<br />
Installed repo's can be seen by:<br />
<br />
yum repolist<br />
yum repolist all # watch for disabled repos<br />
<br />
Some other examples:<br />
<br />
yum-config-manager --add-repo cuda-rhel9.repo<br />
yum install nvidia-driver --disablerepo="rhel-9-for-x86_64-supplementary-rpms"<br />
dnf install nvidia-driver-cuda<br />
<br />
== OLD STUFF ==<br />
<br />
Useful commands:<br />
<br />
''repoquery -i itcl'' - tells which repository contains itcl package<br />
<br />
To remove package:<br />
<br />
yum --setopt=tsflags=noscripts remove <package><br />
<br />
Sometimes it is useful to delete some files:<br />
<br />
rm -f /var/lib/rpm/__db.*<br />
<br />
'''On CensOS on VTP, it was some problem:'''<br />
<br />
Hi Bryan,<br />
on yum updates, I tried<br />
[base]<br />
name=CentOS-$releasever - Base<br />
baseurl=http://vault.centos.org/altarch/$releasever/os/$basearch/<br />
and it gives me this:<br />
http://vault.centos.org/altarch/7/os/armhfp/repodata/repomd.xml: [Errno 14] HTTPS Error 301 - Moved Permanently<br />
Trying other mirror.<br />
If I change 'http:' to 'https:' it gives me this:<br />
https://vault.centos.org/altarch/7/os/armhfp/repodata/repomd.xml: [Errno 14] curl#60 - "Peer's certificate issuer has been marked as not trusted by the user."<br />
Trying other mirror.<br />
I added key<br />
sslverify=0<br />
on the next line after https:... and yum seems updating now, will see.<br />
Sergey<br />
<br />
Final ''/etc/yum.repos.d/CentOS-Base.repo'' looks like this ($releasever=7 and $basearch=armhfp):<br />
<br />
[base]<br />
name=CentOS-$releasever - Base<br />
baseurl=https://vault.centos.org/altarch/$releasever/os/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#released updates <br />
[updates]<br />
name=CentOS-$releasever - Updates<br />
baseurl=https://vault.centos.org/altarch/$releasever/updates/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#additional packages that may be useful<br />
[extras]<br />
name=CentOS-$releasever - Extras<br />
baseurl=https://vault.centos.org/altarch/$releasever/extras/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#additional packages that extend functionality of existing packages<br />
[centosplus]<br />
name=CentOS-$releasever - Plus<br />
baseurl=https://vault.centos.org/altarch/$releasever/centosplus/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=Systemd&diff=8816
Systemd
2026-09-14T20:20:51Z
<p>Boiarino: /* DiagGui example (VTP) */</p>
<hr />
<div>=== Creating service in systemd (RHEL7 and up) ===<br />
<br />
<br />
'''NOTE:''' in the past on Centos5 for DiagGuiServer, placing startup into ''rc.local'' works better - no extra environment settings from clasrun user was required, probably because of rc.local executed AFTER all systemd services, have to understand. Example of the working ''/etc/rc.d/rc.local'':<br />
<br />
touch /var/lock/subsys/local<br />
<br />
rm -f /var/log/DiagGuiServer.log<br />
touch /var/log/DiagGuiServer.log<br />
chmod 777 /var/log/DiagGuiServer.log<br />
su clasrun -c "DiagGuiServer init >> /var/log/DiagGuiServer.log &"<br />
<br />
<br />
<br />
'''NOTES:'''<br />
<br />
systemctl list-units | grep -o '.*\.mount'<br />
<br />
== DiagGuiServer example (VME) ==<br />
<br />
Create file ''/usr/lib/systemd/system/DiagGuiServer.service'' with following contents:<br />
<br />
[Unit]<br />
Description=DiagGuiServer<br />
#After=network.target<br />
#Requires=autofs.service<br />
#Requires=nfs-utils.service nfs-lock.service autofs.service<br />
#Requires=autofs.service<br />
#After=network.target apps.mount home.mount usr-clas12.mount usr-local.mount<br />
#After=-.mount<br />
#RequiresMountsFor=/usr/clas12/release/2.0.0/coda/Linux_x86_64_RHEL7_vme/bin<br />
#Wants=remote-fs.target<br />
#After=remote-fs.target<br />
#ConditionPathExists=/usr/clas12/release/2.0.0/coda/Linux_x86_64_RHEL7_vme/bin <br />
<br />
[Service]<br />
Type=simple<br />
User=clasrun<br />
Group=onliners<br />
ExecStart=/usr/clas12/release/2.0.0/coda/Linux_x86_64_RHEL7_vme/bin/DiagGuiServer init<br />
Restart=on-failure<br />
RestartSec=10<br />
<br />
[Install]<br />
WantedBy=multi-user.target<br />
<br />
<br />
'''NOTE:''' various commented out settings in [Unit] section were tried to make sure DiagGuiServer service run after everything else is ready (in particular automounts), but nothing really worked; solution was to allow restart on failure in section [Service], so after a couple of failures service DiagGuiServer finally starts.<br />
<br />
<br />
Create directory ''/etc/systemd/system/DiagGuiServer.service.d/''<br />
<br />
Create file ''/etc/systemd/system/DiagGuiServer.service.d/override.conf'' with following contents:<br />
<br />
[Service]<br />
Environment="LD_LIBRARY_PATH=/apps/gcc/11.5.0/lib:/apps/gcc/11.5.0/lib64:/usr/lib:/usr/local/lib:/usr/local/activemq/lib:/usr/clas12/release/2.0.0/coda/Linux_x86_64_RHEL7_vme/lib:/usr/clas12/release/2.0.0/clon/Linux_x86_64_RHEL7_vme/lib:/usr/clas12/release/2.0.0/clon/lib"<br />
Environment="IPC_HOST=clon00"<br />
Environment="MYSQL_HOST=clondb1"<br />
Environment="EXPID=clasrun"<br />
Environment="CLON_PARMS=/usr/clas12/release/2.0.0/parms"<br />
<br />
Following commands can be used to control service:<br />
<br />
systemctl daemon-reload<br />
systemctl start DiagGuiServer<br />
systemctl stop DiagGuiServer<br />
systemctl status DiagGuiServer<br />
<br />
In case of problems, useful command:<br />
<br />
journalctl -u DiagGuiServer<br />
<br />
To start service at boot time, execute command:<br />
<br />
systemctl enable DiagGuiServer<br />
<br />
following message should come up on screen:<br />
<br />
Created symlink from /etc/systemd/system/multi-user.target.wants/DiagGuiServer.service to /usr/lib/systemd/system/DiagGuiServer.service.<br />
<br />
== DiagGui example (VTP) ==<br />
<br />
'''NOTE: we are not running vtpserver any more - firmware is loaded at Prestart from rol !!!'''<br />
<br />
Create file ''/usr/lib/systemd/system/DiagGuiServer.service'' with following contents:<br />
<br />
[Service]<br />
##<br />
## see /etc/systemd/system/DiagGuiServer.service.d/override.conf<br />
##Environment="LD_LIBRARY_PATH=/usr/clas12/release/2.0.0/coda/Linux_armv7l_RHEL7/lib:/usr/local/activemq/lib" "SESSION=clasprod" "EXPID=clasrun" "IPC_HOST=clon00" "CLON_PARMS=/usr/clas12/release/2.0.0/parms" "MYSQL_HOST=clondb1"<br />
##<br />
User=clasrun<br />
Group=onliners<br />
Type=simple<br />
ExecStart=/usr/clas12/release/2.0.0/coda/Linux_armv7l_RHEL7/bin/vtpserver<br />
Restart=no<br />
<br />
[Install]<br />
WantedBy=multi-user.target<br />
<br />
Create directory /etc/systemd/system/DiagGuiServer.service.d/.<br />
<br />
Create file /etc/systemd/system/DiagGuiServer.service.d/override.conf with following contents: <br />
<br />
[Service]<br />
Environment="LD_LIBRARY_PATH=/apps/gcc/11.5.0/lib:/apps/gcc/11.5.0/lib64:/usr/clas12/release/2.0.0/coda/Linux_armv7l_RHEL7/lib:/usr/local/activemq/lib"<br />
Environment="SESSION=clasprod"<br />
Environment="EXPID=clasrun"<br />
Environment="IPC_HOST=clon00"<br />
Environment="CLON_PARMS=/usr/clas12/release/2.0.0/parms"<br />
Environment="MYSQL_HOST=clondb1"<br />
<br />
Following commands can be used to control service:<br />
<br />
systemctl daemon-reload<br />
systemctl start DiagGuiServer<br />
systemctl stop DiagGuiServer<br />
systemctl status DiagGuiServer<br />
<br />
In case of problems, useful command:<br />
<br />
journalctl -u DiagGuiServer<br />
<br />
To start service at boot time, execute command:<br />
<br />
systemctl enable DiagGuiServer<br />
<br />
following message should come up on screen:<br />
<br />
Created symlink from /etc/systemd/system/multi-user.target.wants/DiagGuiServer.service to /usr/lib/systemd/system/DiagGuiServer.service.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=Systemd&diff=8815
Systemd
2026-09-14T18:50:09Z
<p>Boiarino: /* Creating service in systemd (RHEL7 and up) */</p>
<hr />
<div>=== Creating service in systemd (RHEL7 and up) ===<br />
<br />
<br />
'''NOTE:''' in the past on Centos5 for DiagGuiServer, placing startup into ''rc.local'' works better - no extra environment settings from clasrun user was required, probably because of rc.local executed AFTER all systemd services, have to understand. Example of the working ''/etc/rc.d/rc.local'':<br />
<br />
touch /var/lock/subsys/local<br />
<br />
rm -f /var/log/DiagGuiServer.log<br />
touch /var/log/DiagGuiServer.log<br />
chmod 777 /var/log/DiagGuiServer.log<br />
su clasrun -c "DiagGuiServer init >> /var/log/DiagGuiServer.log &"<br />
<br />
<br />
<br />
'''NOTES:'''<br />
<br />
systemctl list-units | grep -o '.*\.mount'<br />
<br />
== DiagGuiServer example (VME) ==<br />
<br />
Create file ''/usr/lib/systemd/system/DiagGuiServer.service'' with following contents:<br />
<br />
[Unit]<br />
Description=DiagGuiServer<br />
#After=network.target<br />
#Requires=autofs.service<br />
#Requires=nfs-utils.service nfs-lock.service autofs.service<br />
#Requires=autofs.service<br />
#After=network.target apps.mount home.mount usr-clas12.mount usr-local.mount<br />
#After=-.mount<br />
#RequiresMountsFor=/usr/clas12/release/2.0.0/coda/Linux_x86_64_RHEL7_vme/bin<br />
#Wants=remote-fs.target<br />
#After=remote-fs.target<br />
#ConditionPathExists=/usr/clas12/release/2.0.0/coda/Linux_x86_64_RHEL7_vme/bin <br />
<br />
[Service]<br />
Type=simple<br />
User=clasrun<br />
Group=onliners<br />
ExecStart=/usr/clas12/release/2.0.0/coda/Linux_x86_64_RHEL7_vme/bin/DiagGuiServer init<br />
Restart=on-failure<br />
RestartSec=10<br />
<br />
[Install]<br />
WantedBy=multi-user.target<br />
<br />
<br />
'''NOTE:''' various commented out settings in [Unit] section were tried to make sure DiagGuiServer service run after everything else is ready (in particular automounts), but nothing really worked; solution was to allow restart on failure in section [Service], so after a couple of failures service DiagGuiServer finally starts.<br />
<br />
<br />
Create directory ''/etc/systemd/system/DiagGuiServer.service.d/''<br />
<br />
Create file ''/etc/systemd/system/DiagGuiServer.service.d/override.conf'' with following contents:<br />
<br />
[Service]<br />
Environment="LD_LIBRARY_PATH=/apps/gcc/11.5.0/lib:/apps/gcc/11.5.0/lib64:/usr/lib:/usr/local/lib:/usr/local/activemq/lib:/usr/clas12/release/2.0.0/coda/Linux_x86_64_RHEL7_vme/lib:/usr/clas12/release/2.0.0/clon/Linux_x86_64_RHEL7_vme/lib:/usr/clas12/release/2.0.0/clon/lib"<br />
Environment="IPC_HOST=clon00"<br />
Environment="MYSQL_HOST=clondb1"<br />
Environment="EXPID=clasrun"<br />
Environment="CLON_PARMS=/usr/clas12/release/2.0.0/parms"<br />
<br />
Following commands can be used to control service:<br />
<br />
systemctl daemon-reload<br />
systemctl start DiagGuiServer<br />
systemctl stop DiagGuiServer<br />
systemctl status DiagGuiServer<br />
<br />
In case of problems, useful command:<br />
<br />
journalctl -u DiagGuiServer<br />
<br />
To start service at boot time, execute command:<br />
<br />
systemctl enable DiagGuiServer<br />
<br />
following message should come up on screen:<br />
<br />
Created symlink from /etc/systemd/system/multi-user.target.wants/DiagGuiServer.service to /usr/lib/systemd/system/DiagGuiServer.service.<br />
<br />
== DiagGui example (VTP) ==<br />
<br />
Create file ''/usr/lib/systemd/system/DiagGuiServer.service'' with following contents:<br />
<br />
[Service]<br />
##<br />
## see /etc/systemd/system/DiagGuiServer.service.d/override.conf<br />
##Environment="LD_LIBRARY_PATH=/usr/clas12/release/2.0.0/coda/Linux_armv7l_RHEL7/lib:/usr/local/activemq/lib" "SESSION=clasprod" "EXPID=clasrun" "IPC_HOST=clon00" "CLON_PARMS=/usr/clas12/release/2.0.0/parms" "MYSQL_HOST=clondb1"<br />
##<br />
User=clasrun<br />
Group=onliners<br />
Type=simple<br />
ExecStart=/usr/clas12/release/2.0.0/coda/Linux_armv7l_RHEL7/bin/vtpserver<br />
Restart=no<br />
<br />
[Install]<br />
WantedBy=multi-user.target<br />
<br />
Create directory /etc/systemd/system/DiagGuiServer.service.d/.<br />
<br />
Create file /etc/systemd/system/DiagGuiServer.service.d/override.conf with following contents: <br />
<br />
[Service]<br />
Environment="LD_LIBRARY_PATH=/apps/gcc/11.5.0/lib:/apps/gcc/11.5.0/lib64:/usr/clas12/release/2.0.0/coda/Linux_armv7l_RHEL7/lib:/usr/local/activemq/lib"<br />
Environment="SESSION=clasprod"<br />
Environment="EXPID=clasrun"<br />
Environment="IPC_HOST=clon00"<br />
Environment="CLON_PARMS=/usr/clas12/release/2.0.0/parms"<br />
Environment="MYSQL_HOST=clondb1"<br />
<br />
Following commands can be used to control service:<br />
<br />
systemctl daemon-reload<br />
systemctl start DiagGuiServer<br />
systemctl stop DiagGuiServer<br />
systemctl status DiagGuiServer<br />
<br />
In case of problems, useful command:<br />
<br />
journalctl -u DiagGuiServer<br />
<br />
To start service at boot time, execute command:<br />
<br />
systemctl enable DiagGuiServer<br />
<br />
following message should come up on screen:<br />
<br />
Created symlink from /etc/systemd/system/multi-user.target.wants/DiagGuiServer.service to /usr/lib/systemd/system/DiagGuiServer.service.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=Yum&diff=8814
Yum
2026-09-11T21:20:02Z
<p>Boiarino: /* yum/dnf at jlab */</p>
<hr />
<div>== yum/dnf at jlab ==<br />
<br />
'''NOTE:''' file ''/etc/dnf/plugins/subscription-manager.conf'' contains by default line ''disable_system_repos=1'', '''which makes all repositories defined outside redhat.repo to be disabled'''<br />
<br />
To add repo's:<br />
<br />
subscription-manager repos --enable <repo_id><br />
<br />
<br />
In particular, following have to be enabled to get nload, xpdf, python-alembic, tix, itcl, itk etc:<br />
<br />
subscription-manager repos --enable JLab_EPEL_EPEL_7<br />
subscription-manager repos --enable rhel-7-workstation-optional-rpms<br />
<br />
Repo ID's can be obtained by:<br />
<br />
subscription-manager repos --list<br />
<br />
Installed repo's can be seen by:<br />
<br />
yum repolist<br />
yum repolist all # watch for disabled repos<br />
<br />
Some other examples:<br />
<br />
yum-config-manager --add-repo cuda-rhel9.repo<br />
yum install nvidia-driver --disablerepo="rhel-9-for-x86_64-supplementary-rpms"<br />
<br />
== OLD STUFF ==<br />
<br />
Useful commands:<br />
<br />
''repoquery -i itcl'' - tells which repository contains itcl package<br />
<br />
To remove package:<br />
<br />
yum --setopt=tsflags=noscripts remove <package><br />
<br />
Sometimes it is useful to delete some files:<br />
<br />
rm -f /var/lib/rpm/__db.*<br />
<br />
'''On CensOS on VTP, it was some problem:'''<br />
<br />
Hi Bryan,<br />
on yum updates, I tried<br />
[base]<br />
name=CentOS-$releasever - Base<br />
baseurl=http://vault.centos.org/altarch/$releasever/os/$basearch/<br />
and it gives me this:<br />
http://vault.centos.org/altarch/7/os/armhfp/repodata/repomd.xml: [Errno 14] HTTPS Error 301 - Moved Permanently<br />
Trying other mirror.<br />
If I change 'http:' to 'https:' it gives me this:<br />
https://vault.centos.org/altarch/7/os/armhfp/repodata/repomd.xml: [Errno 14] curl#60 - "Peer's certificate issuer has been marked as not trusted by the user."<br />
Trying other mirror.<br />
I added key<br />
sslverify=0<br />
on the next line after https:... and yum seems updating now, will see.<br />
Sergey<br />
<br />
Final ''/etc/yum.repos.d/CentOS-Base.repo'' looks like this ($releasever=7 and $basearch=armhfp):<br />
<br />
[base]<br />
name=CentOS-$releasever - Base<br />
baseurl=https://vault.centos.org/altarch/$releasever/os/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#released updates <br />
[updates]<br />
name=CentOS-$releasever - Updates<br />
baseurl=https://vault.centos.org/altarch/$releasever/updates/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#additional packages that may be useful<br />
[extras]<br />
name=CentOS-$releasever - Extras<br />
baseurl=https://vault.centos.org/altarch/$releasever/extras/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#additional packages that extend functionality of existing packages<br />
[centosplus]<br />
name=CentOS-$releasever - Plus<br />
baseurl=https://vault.centos.org/altarch/$releasever/centosplus/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=Yum&diff=8813
Yum
2026-09-11T20:20:37Z
<p>Boiarino: /* yum/dnf at jlab */</p>
<hr />
<div>== yum/dnf at jlab ==<br />
<br />
'''NOTE: file ''/etc/dnf/plugins/subscription-manager.conf'' contains by default line ''disable_system_repos=1'', which makes all repositories defined outside redhat.repo to be disabled'''<br />
<br />
To add repo's:<br />
<br />
subscription-manager repos --enable <repo_id><br />
<br />
<br />
In particular, following have to be enabled to get nload, xpdf, python-alembic, tix, itcl, itk etc:<br />
<br />
subscription-manager repos --enable JLab_EPEL_EPEL_7<br />
subscription-manager repos --enable rhel-7-workstation-optional-rpms<br />
<br />
Repo ID's can be obtained by:<br />
<br />
subscription-manager repos --list<br />
<br />
Installed repo's can be seen by:<br />
<br />
yum repolist<br />
yum repolist all # watch for disabled repos<br />
<br />
Some other examples:<br />
<br />
yum-config-manager --add-repo cuda-rhel9.repo<br />
yum install nvidia-driver --disablerepo="rhel-9-for-x86_64-supplementary-rpms"<br />
<br />
== OLD STUFF ==<br />
<br />
Useful commands:<br />
<br />
''repoquery -i itcl'' - tells which repository contains itcl package<br />
<br />
To remove package:<br />
<br />
yum --setopt=tsflags=noscripts remove <package><br />
<br />
Sometimes it is useful to delete some files:<br />
<br />
rm -f /var/lib/rpm/__db.*<br />
<br />
'''On CensOS on VTP, it was some problem:'''<br />
<br />
Hi Bryan,<br />
on yum updates, I tried<br />
[base]<br />
name=CentOS-$releasever - Base<br />
baseurl=http://vault.centos.org/altarch/$releasever/os/$basearch/<br />
and it gives me this:<br />
http://vault.centos.org/altarch/7/os/armhfp/repodata/repomd.xml: [Errno 14] HTTPS Error 301 - Moved Permanently<br />
Trying other mirror.<br />
If I change 'http:' to 'https:' it gives me this:<br />
https://vault.centos.org/altarch/7/os/armhfp/repodata/repomd.xml: [Errno 14] curl#60 - "Peer's certificate issuer has been marked as not trusted by the user."<br />
Trying other mirror.<br />
I added key<br />
sslverify=0<br />
on the next line after https:... and yum seems updating now, will see.<br />
Sergey<br />
<br />
Final ''/etc/yum.repos.d/CentOS-Base.repo'' looks like this ($releasever=7 and $basearch=armhfp):<br />
<br />
[base]<br />
name=CentOS-$releasever - Base<br />
baseurl=https://vault.centos.org/altarch/$releasever/os/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#released updates <br />
[updates]<br />
name=CentOS-$releasever - Updates<br />
baseurl=https://vault.centos.org/altarch/$releasever/updates/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#additional packages that may be useful<br />
[extras]<br />
name=CentOS-$releasever - Extras<br />
baseurl=https://vault.centos.org/altarch/$releasever/extras/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#additional packages that extend functionality of existing packages<br />
[centosplus]<br />
name=CentOS-$releasever - Plus<br />
baseurl=https://vault.centos.org/altarch/$releasever/centosplus/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=Linux_Installation_Procedure&diff=8812
Linux Installation Procedure
2026-09-11T20:16:57Z
<p>Boiarino: /* RHEL7 (64 bit) */</p>
<hr />
<div>== Dell servers hardware trick(s) ==<br />
<br />
* '''!!! if BIOS date/time is incorrect, it may prevent redhat subscription and installation to work correctly, set it to correct value !!! (it was not confirmed, problem may be different and was fixed at the same time as time was correctly set) '''<br />
<br />
* if BIOS does not remember time setting after power unplugged, battery on motherboard may need to be replaced<br />
<br />
* if looks dead, remove the power cords, then held in the on button for 30 seconds; then plug it back in and it may boots up fine - known Dell feature<br />
<br />
== ARM (CentsOS7) ==<br />
<br />
See [[yum]] for specifics.<br />
<br />
yum install xauth wget bzip2 xterm expat-devel libX11-devel libXpm-devel motif-devel mariadb-devel<br />
<br />
== RHEL9 (64 bit) - machine under puppet control ==<br />
<br />
'''NOTE''': select installation type '''H''', then type '''B'''.<br />
<br />
'''NOTE''': during custom disk partitioning, select 'Standard' for every partition, if you want it to be standard, or 'Raid' if applicable<br />
<br />
Root password will be set by puppet during installation, as well as most other needed settings.<br />
<br />
Install useful packages:<br />
yum install ncdu mysql gfortran<br />
<br />
'''NOTE''': graphic screen is disabled, run following command as root:<br />
systemctl set-default graphical.target<br />
<br />
== RHEL9 (64 bit) - for machine NOT under puppet control ==<br />
<br />
'''NOTE''': select installation type '''D''' (not '''S''', otherwise it will not be level 2 server)<br />
<br />
'''NOTE''': during custom disk partitioning, select 'Standard' for every partition, if you want it to be standard, or 'Raid' if applicable<br />
<br />
When installation complete, ssh as authorized user and do following:<br />
<br />
sudo yum install emacs<br />
cd /etc<br />
sudo chmod a+rw shadow<br />
sudo emacs shadow<br />
<br />
Copy to /etc/shadow root and other needed passwords from another clon machine. <br />
<br />
sudo chmod a-rw shadow<br />
<br />
After that, type ''su'' to become superuser. All following settings can be done now without typing ''sudo'' every time. You still will not be able to ssh remotely as root - always ssh as authorized user and type ''su'' to become root.<br />
<br />
Update /etc/passwd and /etc/group using another clon machine as example.<br />
<br />
yum install expat-devel libXaw-devel mysql-devel motif-devel ncurses-devel apr-devel net-snmp-utils<br />
yum install xorg-x11-utils # for xprop/xwininfo/etc creg stuff<br />
yum install s-nail # for /usr/bin/mail<br />
yum install ncdu gfortran<br />
yum install libconfig-devel # recent addition for CODA libraries<br />
<br />
To be able to ssh to old machines (like vme controllers under CentOS5), run following as root:<br />
<br />
update-crypto-policies --set LEGACY<br />
<br />
and then probably reboot, not sure.<br />
<br />
Somebody mentioned also adding ''RequiredRSASize 1024'' to a config file in ''/etc/ssh/ssh_config.d/'', but I did not do it.<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
Note: this changes all daemons and system settings and is a bit overkill if you only need to adjust the settings for ssh and sshd.<br />
<br />
Exclude (only) sshd from the system-wide cryptographic policy. You opt-out by editing /etc/sysconfig/sshd and uncommenting the line # CRYPTO_POLICY= , (if necessary you can then adjust adjust /etc/ssh/sshd_config and add legacy crypto settings) and restart the ssh daemon.<br />
<br />
For the ssh command line client on the RHEL 9 system: you're recommended to edit ˜/.ssh/config and override the modern/secure system wide ssh client defaults by adding a Host entry that adds support for suitable legacy encryption options for that particular host:<br />
<br />
# ˜/.ssh/config<br />
<br />
Host rhel6.example.com<br />
KexAlgorithms +diffie-hellman-group14-sha1<br />
MACs +hmac-sha1<br />
HostKeyAlgorithms +ssh-rsa<br />
PubkeyAcceptedKeyTypes +ssh-rsa<br />
PubkeyAcceptedAlgorithms +ssh-rsa<br />
<br />
Prepare auto-mounting directories:<br />
<br />
cd /<br />
mv apps apps.orig<br />
mv home home.orig<br />
mv scratch scratch.orig<br />
mv work work.orig<br />
mkdir apps<br />
mkdir home<br />
mkdir scratch<br />
mkdir work<br />
mkdir logs<br />
cd /usr<br />
mv local local.orig<br />
mkdir local<br />
mkdir clas<br />
mkdir clas12<br />
mkdir downloads<br />
cd<br />
<br />
== RHEL8 (64 bit) ==<br />
<br />
'''NOTE:''' to boot from USB stick, insert USB stick, turn machine ON holding F2, and in BIOS Boot Configuration, set Enable Security Boot to OFF, save and exit, holding F2. When in BIOS again, in Boot Configuration make ''UEFI PHY USB ...'' first in boot sequence, local hard drive second, disable all other boot options, save and exit. Do NOT hold F2, Linux installation from USB stick will start. '''IMPORTANT:''' when asked about D/S options (very first question in installation process), '''REMOVE USB STICK BEFORE ANSWERING QUESTION ABOUT DESKTOP/SERVER''', otherwise it will be destroyed by following installation steps !!!<br />
<br />
'''NOTE:''' to disable/enable puppet, do following as root: <br />
puppet agent --disable "temporary"<br />
puppet agent --enable<br />
<br />
yum install emacs<br />
yum install xorg-x11-fonts-misc<br />
<br />
Move and create some directories in preparation for automounts:<br />
<br />
cd /<br />
mv apps apps.orig<br />
mv home home.orig<br />
mv scratch scratch.orig<br />
mkdir apps<br />
mkdir home<br />
mkdir scratch<br />
mkdir work<br />
mkdir logs<br />
cd /usr<br />
mv local local.orig<br />
mkdir local<br />
mkdir clas<br />
mkdir clas12<br />
mkdir downloads<br />
cd<br />
<br />
Add line '''+dir:/etc/auto.master.d''' to ''/etc/auto.master''<br />
<br />
Create file ''/etc/auto.master.d/direct.autofs'' with the line '''/- /etc/auto.direct'''<br />
<br />
Create file ''/etc/auto.direct'' with the following contents:<br />
<br />
# machine-dependent system directories<br />
/apps -rw,bg clonfs1:/vol/apps/RHEL8_x86_64<br />
/usr/local -rw,bg clonfs1:/vol/local/RHEL8_x86_64<br />
# machine-independent system directories<br />
/home -rw,bg clonfs1:/vol/home<br />
#/work -rw,bg clonfs1-old:/vol/work<br />
/scratch -rw,bg clonfs1:/vol/scratch<br />
# machine-independent clas directories<br />
/usr/downloads -rw,bg clonfs1:/vol/downloads<br />
/usr/clas -rw,bg clonfs1:/vol/clas<br />
/usr/clas12 -rw,bg clonfs1:/vol/clas12<br />
# Used for data storage before shipping to tape<br />
#/logs -rw,bg clonfs1-old:/vol/logs<br />
<br />
Restart autofs:<br />
<br />
service autofs reload<br />
service autofs restart<br />
<br />
Remove from the end of the ''/etc/passwd'' line '''+::::::''', and add following:<br />
<br />
hpsrun:x:8796:9998:hpsrun Account:/home/hpsrun:/bin/tcsh<br />
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh<br />
clasioc:x:6008:9998:CLAS IOCs:/home/clasioc:/bin/tcsh<br />
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh<br />
clascron:x:3888:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh<br />
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh<br />
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh<br />
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh<br />
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh<br />
+@clon_cluster::::::<br />
+sshd::::::<br />
+::::::/bin/false<br />
<br />
Update ''/etc/shadow'', adding passwords for local accounts (copy it from another machine).<br />
<br />
Add following to ''/etc/group'':<br />
<br />
clon:x:383:clascron<br />
onliners:x:9998:abbottd,avakian,baltzell,battagli,brooksw,bruhwel,boiarino,carman,chen,clasboot,clascron,clasrun,cole,cuevas,davidl,danagu,dugger,elton,epics,fklein,gilfoyle,giovanet,golovach,gurjyan,heddle,heyes,hovanes,jacobsg,jenkins,kliv,lcsmith,marki,mestayer,nerses,parkkj,pasyuk,primex,ripani,rossi,saw,staylor,sytnik,taiuti,taylorw,timmer,wooyoung<br />
<br />
== RHEL7 (64 bit) ==<br />
<br />
Installed using DVD provided by Computer Center, currently RHEL7.3. Requires MAC address to be registered with Computer Center (using jnet.jlab.org as 'boiarino') because it is network-based installation. On DELL servers, hold F2 after power on and go to 'Device Settings' to see mac address. Remember machine memory size as well, will needed when create partitions, find it in 'System BIOS -> Memory Settings'.<br />
<br />
'''NOTE: all disks will be reformatted in a process, all information will be lost !'''<br />
<br />
Dialog:<br />
<br />
* boot: <enter><br />
<br />
* Please enter the hostname of this system: <hostname> <enter><br />
<br />
* What type of system are you building? (D)esktop: <enter><br />
<br />
* Is this a CUE level 1 or CUE level 2 System build (1/2): 2 <enter><br />
<br />
* Please enter the System Admin's CUE username: boiarino <enter><br />
<br />
* Do you want to use the default partitioning scheme (y/n)? n <enter><br />
<br />
* Are you sure you want to use your own partitioning scheme (y/n)? y <enter><br />
<br />
Choose 'Standard Partition' scheme and create following partitions: /boot - 1GB, swap - double memory size, / - the rest of space.<br />
<br />
Installation will proceed. When prompted, remove installation disk and reboot machine if not done automatically.<br />
<br />
After reboot patching process will be started and it will take a while, do not interrupt it, otherwise system will not be installed correctly.<br />
<br />
When machine reboots for the last time, ask Paul Letta to set usual hallb root password. From now on remote root access is possible. Alternatively, user ''boiarino'' can execute most of actions using ''sudo'',<br />
like ''sudo emacs'' for protected files. ''sudo reboot'' etc.<br />
<br />
Go to /boot/grub2 and modify file grub.cfg, Linux kernel boot options, adding options ''net.ifnames=0 biosdevname=0'', so your boot string has following section:<br />
<br />
..... rhgb net.ifnames=0 biosdevname=0 quiet .....<br />
<br />
so whole line looks something like this:<br />
<br />
linux16 /vmlinuz-3.10.0-327.18.2.el7.x86_64 root=UUID=b5d1b5ad-e3f6-4db4-8972-aa9c1a91d116 ro vconsole.keymap=us crashkernel=auto vconsole.font=latarcyrheb-sun16 rhgb net.ifnames=0 biosdevname=0 quiet LANG=en_US.UTF-8<br />
<br />
Reboot machine, ethernet ports must be named ''eth0'', ''eth1'' etc.<br />
<br />
To update manually, use commands ''yum list updates'' and ''yum update''.<br />
<br />
<br />
'''NOTE:''' add machine to the appropriate '''puppet''' group, it will do all following automatically (hopefully).<br />
<br />
'''NOTE:''' on RHEL7.9, RPM EPEL REPO is not enabled by default, which prevents from installing nload, itcl, itk etc. To bring it back, it can be copied it from older machine, for example:<br />
<br />
cd /etc/yum.repos.d<br />
scp clondaq7:/etc/yum.repos.d/epel.repo .<br />
cd /etc/pki/rpm-gpg<br />
scp clondaq7:/etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-7 .<br />
<br />
Alternatively, following can be used to add repo's:<br />
<br />
subscription-manager repos --enable <repo_id><br />
<br />
see [[yum]] for more details.<br />
<br />
<br />
'''Yum updates'''<br />
<br />
Edit the ''/etc/yum.conf'' file and add the following line to force installation of the 32bit and 64bit libraries:<br />
<br />
multilib_policy=all<br />
<br />
Install following packages:<br />
<br />
yum install xterm mesa-dri-drivers telnet rsh readline-devel net-snmp-utils tigervnc-server tigervnc xpdf nload mariadb-devel libxml2-devel glibc-devel qt-devel python-alembic openssl-devel apr-devel<br />
yum install libconfig-devel # recent addition for CODA libraries<br />
<br />
Fonts for EPICS EDMs:<br />
<br />
yum install xorg-x11-fonts-75dpi xorg-x11-fonts-ISO8859-1-75dpi bitmap-miscfixed-fonts<br />
yum install bitmap-console-fonts bitmap-fixed-fonts bitmap-lucida-typewriter-fonts<br />
ln -s /usr/share/X11/fonts/100dpi /etc/X11/fontpath.d/xorg-x11-fonts-100dpi:pri=60<br />
ln -s /usr/share/X11/fonts/75dpi /etc/X11/fontpath.d/xorg-x11-fonts-75dpi:pri=50<br />
ln -s /usr/share/X11/fonts/misc /etc/X11/fontpath.d/xorg-x11-fonts-misc:pri=40<br />
ln -s /usr/share/fonts/bitmap /etc/X11/fontpath.d/bitmap-fonts<br />
<br />
<br />
Do following to be able to compile and run 32-bit apps on 64-bit machine (for compatibility with 32bit applications):<br />
<br />
yum install libXpm-devel libXaw-devel motif-devel glibc-devel ncurses-devel readline-devel<br />
<br />
<br />
<br />
Modify file ''/etc/passwd'' adding following:<br />
<br />
hpsrun:x:8796:9998:hpsrun Account:/home/hpsrun:/bin/tcsh<br />
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh<br />
clasioc:x:6008:9998:CLAS IOCs:/home/clasioc:/bin/tcsh<br />
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh<br />
clascron:x:3888:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh<br />
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh<br />
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh<br />
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh<br />
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh<br />
+@clon_cluster::::::<br />
+sshd::::::<br />
+::::::/bin/false<br />
<br />
'''Note''': user-related lines must be removed, like<br />
<br />
+boiarino::::::<br />
<br />
as well as<br />
<br />
+::::::<br />
<br />
'''Note''': assumed that following line is in already:<br />
<br />
+@ccc::::::<br />
<br />
'''Note''': if following line exist, it must be placed in the end, or removed:<br />
<br />
+::::::/bin/false<br />
<br />
<br />
Modify file ''/etc/group'' adding following:<br />
<br />
onliners::9998:heyes,hujl,rwm,timmer,wolin,taylorw,cuevas,abbottd,abulafia,anciant,anghi,aswin,auger,avakian,banta,barrow,battagli,bjlee,bogdan,brooksw,bruhwel,boiarino,buckle,burchesk,burin,bzh,cetina,chen,cole,cords,corvi,costy,davidl,costy,davidl,dcarter,dcurry,dennisl,deppman,dhlee,doughty,drago,dytman,dugger,dugger,elton,fedro,ficenec,fklein,france,freyberg,gholden,gilfoyle,golovach,gurjyan,haddock,heddle,jenkins,jhardie,jmorris,kellyk,klusman,kmkim,kossov,lcsmith,longhi,manak,marchand,marki,mastersj,mjohnson,mosbackr,mueller,muguira,murphyl,necaise,odonnell,opper,parkkj,pasyuk,phkim,piot,riccardi,richardt,ripani,rossi,saw,sergpozd,serov,sholt,staylor,taiuti,tang,tedeschi,vineyard,vlassov,vvsap,weygand,wooyoung,burchesk,clasrun,giovanet,clasboot,clascoda,clasroot,clasmail,clascron,trigger,epics,southern,carstens,ccutter,danagu,heyes,huertas,jacobsg,kliv,lachniet,mestayer,primex,hovanes,nerses,sytnik,baltzell,carman<br />
clon::383:clascoda,clascron,clasmail<br />
nagios::9997:nagios<br />
<br />
Modify file ''/etc/shadow'' using an example from another RHEL7 clon machine (clonioc2 etc). Do ''chmod 600 shadow'' before editing and ''chmod 000 shadow'' after.<br />
<br />
Make sure file ''/etc/ssh/sshd_config'' has following line uncommented (must be pushed in by CC security scripts):<br />
<br />
##PermitUserEnvironment yes<br />
<br />
NOT NEEDED, DONE IN THE END OF FILE ALREADY !!! Uncomment following in file ''/etc/ssh/ssh_config'':<br />
<br />
##Host *<br />
##ForwardX11 yes<br />
<br />
Add line 'export NO_AT_BRIDGE=1' to the file '/etc/environment' to suppress annoying messages like '** (emacs:38714): WARNING **: Couldn't register with accessibility bus: Did not receive a reply.'<br />
<br />
If big (>2GB) partition to be formated, do following (for example /dev/sdb):<br />
<br />
parted /dev/sdb<br />
(parted) print<br />
(parted) mklabel gpt<br />
(parted) print<br />
mkpart primary 0GB 25855.2GB<br />
(parted) print<br />
(parted) quit<br />
<br />
mkfs.xfs /dev/sdb1<br />
<br />
then create /data and mount it using ''/etc/fstab'':<br />
<br />
/dev/sdb1 /data xfs defaults 1 2<br />
<br />
<br />
'''NOTE:''' sometimes machine can loose NIS connection, then ssh to it becomes intermittent; if it happens ssh as root (may have to try several times) and run command<br />
<br />
ypwhich<br />
<br />
to shows NIS server. If it returns nothing check file ''/etc/resolv.conf'', it must have following (as on July 2019):<br />
<br />
search jlab.org acc.jlab.org<br />
nameserver 129.57.90.255<br />
nameserver 129.57.32.101<br />
<br />
If file is empty or does not contain right info, fix it. After that run command<br />
<br />
ypbind<br />
<br />
It should fix a problem. Run ''ypwhich'' to make sure.<br />
<br />
<br />
'''Display Setting:''' if machine is multi-head, goto ''Applications->System Tools->Settings->Devices->Displays'' and arrange displays.<br />
<br />
<br />
Proceed to the [[Linux Customization on CLON Cluster]].<br />
<br />
== RHEL6 (64 bit) ==<br />
<br />
Installed using CD provided by Computer Center. Requires MAC address to be registered with Computer Center (using jnet.jlab.org as 'boiarino') because it is network-based installation.<br />
<br />
'''NOTE: all disks will be reformatted in a process, all information will be lost !'''<br />
<br />
Dialog:<br />
<br />
* boot: <enter><br />
<br />
* ...[D]esktop: [use 's' for server, 'd' for desktop] <enter><br />
<br />
* root password: enter root password<br />
<br />
* admin user: boiarino<br />
<br />
Installation will proceed. When prompted, remove installation disk and reboot machine if not done automatically. After reboot patching process will be started and it will take a while, do not interrupt it, otherwise system will not be installed correctly.<br />
<br />
To make emacs work, install<br />
<br />
yum install libotf<br />
<br />
Edit the /etc/yum.conf file and add the following line to force installation of teh 32bit and 64bit libraries:<br />
<br />
multilib_policy=all<br />
<br />
Install following packages:<br />
<br />
yum install openmotif-devel xinetd mysql-devel cmake libXpm-devel net-snmp-utils<br />
yum install mesa-libGL-devel mesa-libGLU-devel mesa-libGLw-devel (for OpenGL, needed by ROOT)<br />
yum install libXaw-devel (for xterm)<br />
yum install expat-devel libgcj-devel (for evio/et)<br />
<br />
yum install compat-libtermcap (for xterm)<br />
ln -s /lib/libtermcap.so.2 /usr/lib/libtermcap.so<br />
###ln -s /lib64/libtermcap.so.2 /usr/lib64/libtermcap.so<br />
<br />
<br />
Install following fonts for EPICS EDMs:<br />
<br />
yum install xorg-x11-fonts-75dpi xorg-x11-fonts-ISO8859-1-75dpi bitmap-miscfixed-fonts<br />
yum install bitmap-console-fonts bitmap-fixed-fonts bitmap-lucida-typewriter-fonts<br />
ln -s /usr/share/X11/fonts/100dpi /etc/X11/fontpath.d/xorg-x11-fonts-100dpi:pri=60<br />
ln -s /usr/share/X11/fonts/75dpi /etc/X11/fontpath.d/xorg-x11-fonts-75dpi:pri=50<br />
ln -s /usr/share/X11/fonts/misc /etc/X11/fontpath.d/xorg-x11-fonts-misc:pri=40<br />
ln -s /usr/share/fonts/bitmap /etc/X11/fontpath.d/bitmap-fonts<br />
<br />
<br />
'''NOTE:''' Useful ''yum'' commands:<br />
<br />
yum whatprovides libstdc++.so.5 - show which package contains libstdc++.so.5<br />
<br />
== RHEL5 ==<br />
<br />
Installed using CD provided by Computer Center. Requires MAC address to be registered with Computer Center (email to helpdesk@jlab.org) because it is network-based installation.<br />
<br />
Dialog:<br />
<br />
* boot: <enter><br />
<br />
* ...[D]esktop: Server (it is ignored, will do Desktop anyway ...)<br />
<br />
* root password: enter root password<br />
<br />
* system user: <enter><br />
<br />
* manually partition disk: 100MB /boot, 2048 etc MB swap, the rest /.<br />
<br />
'''CFENGINE''': there are procesess restoring some system config files (in particular ''/etc/ssh/sshd_config'') in according to the Computer Center - maintained templete. To shut them down: (1) comment out ''cfengine''-related stuff in root cronjobs; (2) do ''/etc/init.d/cfengine stop''; (3) do ''chkconfig cfengine off''. Ask CC (Sherman White, Paul Letta) to fix templete.<br />
<br />
Run ''/usr/bin/system-config-authentication'' and set NIS servers list as ''clon00,clon10,nis1''.<br />
<br />
Add following in the end of ''/etc/passwd'':<br />
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh<br />
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh<br />
clascron:x:6005:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh<br />
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh<br />
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh<br />
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh<br />
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh<br />
+@clon_cluster::::::<br />
+@ccc::::::<br />
<br />
Add following in the end of ''/etc/group'':<br />
onliners::9998:heyes,hujl,rwm,timmer,wolin,taylorw,cuevas,abbottd,abulafia,anciant,anghi,aswin,auger,avakian,banta,barrow,battagli,bjlee,bogdan,brooksw,bruhwel,boiarino,buckle,burchesk,burin,bzh,cetina,chen,cole,cords,corvi,costy,davidl,costy,davidl,dcarter,dcurry,dennisl,deppman,dhlee,doughty,drago,dytman,dugger,dugger,elton,fedro,ficenec,fklein,france,freyberg,gholden,gilfoyle,golovach,gurjyan,haddock,heddle,jenkins,jhardie,jmorris,kellyk,klusman,kmkim,kossov,lcsmith,longhi,manak,marchand,marki,mastersj,mjohnson,mosbackr,mueller,muguira,murphyl,necaise,odonnell,opper,parkkj,pasyuk,phkim,piot,riccardi,richardt,ripani,rossi,saw,sergpozd,serov,sholt,staylor,taiuti,tang,tedeschi,vineyard,vlassov,vvsap,weygand,wooyoung,burchesk,clasrun,giovanet,clasboot,clascoda,clasroot,clasmail,clascron,trigger,epics,southern,carstens,ccutter,danagu,heyes,huertas,jacobsg,kliv,lachniet,mestayer,primex,hovanes,nerses,sytnik<br />
clon::383:clascoda,clascron,clasmail<br />
nagios::9997:nagios<br />
<br />
Create ''/etc/shadow'' files with entries for users clasrun, epics and nagios (copy from another machine).<br />
<br />
Install updates: normally all updates should be installed by now, it can be done manually by commands<br />
yum list updates<br />
yum update<br />
<br />
Configure [[SSH]].<br />
<br />
Install missing packages:<br />
yum install openmotif-devel xinetd mysql-devel cmake<br />
<br />
Some additional packages on request (for EPICS):<br />
<br />
yum install mc lapack lapack-devel blas blas-devel giflib-devel<br />
<br />
Proceed to the [[Linux Customization on CLON Cluster]].<br />
<br />
'''PROBLEMS''':<br />
<br />
1. /usr/lib/libg2c.so link is missing<br />
<br />
FIXED ??? 2. /usr/lib/libXm.so link is missing<br />
<br />
3. Created /etc/shadow file for clasrun, epics and nagios<br />
<br />
== RHEL4 ==<br />
<br />
Get RHEL4 CDs from Paul Letta.<br />
<br />
Connect terminal, keyboard and mouse.<br />
<br />
Boot from CD1. Follow instructions. When asked, choose following options:<br />
<br />
* Choose 'Manually partition with Disk Druid', set /boot to 100MB, then / to 40GB, then swap to 8192MB or at least double memory size. The rest of disk can be set as /space.<br />
<br />
* Network: choose manually, type clonpc2.jlab.org; click 'EDIT', deactivate 'Configure using DHCP',<br />
type IP address and netmask (255.255.255.0), click Ok.<br />
Type Gateway (for example 129.57.167.99) and 3 DNS servers (129.57.167.5,129.57.167.14,129.57.32.100).<br />
<br />
* Choose 'No firewall'<br />
<br />
* Disable 'SELinux'<br />
<br />
* Choose 'Customize software packages to be installed', click 'Everything'.<br />
<br />
You will be asked to install CD2, CD3 and CD4, then CD1 again.<br />
Then you will be asked to click 'Reboot'. First remove CD, then click 'Reboot'.<br />
You will be asked few more questions. When asked to activate service, choose<br />
'Tell me why I need to register ..' and click 'Next'. Choose 'I can not complete registration ..'<br />
and click 'Next'. You will see 'System user' screen, click 'Use network login..'.<br />
Choose 'Enable NIS support' and click 'Configure NIS'. Type NIS Domain: 'CCCHP' and NIS Server: clon00.jlab.org.<br />
Finish installation process.<br />
<br />
* fix files ''/etc/passwd'', ''/etc/shadow'' and ''/etc/group'' adding clasrun etc (see examples on another machines).<br />
<br />
'''NOTE''': if machine has multiple network ports, Linux may not assign them properly to specified IP names and addresses. If problem occures, open network GUI and delete all existing records. After that, click ''New'' and pick hadrware port you want to configure from the list of available ports (tricky part is to know which RJ-45 connector corresponds to which port ..). Configure and activate it, make sure it works. Repeat for other ports. Results will be stored in directory ''/etc/sysconfig/network-scripts'', file names will be ''ifcfg-eth0'', ''ifcfg-eth1'' etc. If modifying those files manually, restart network by ''/etc/init.d/network restart''. Finally, set routing, for example for ''clonmon'' command ''route -n'' shows following:<br />
Kernel IP routing table<br />
Destination Gateway Genmask Flags Metric Ref Use Iface<br />
129.57.160.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1<br />
129.57.68.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3<br />
129.57.69.0 0.0.0.0 255.255.255.0 U 0 0 0 dev5937<br />
129.57.64.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0<br />
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3<br />
0.0.0.0 129.57.68.100 0.0.0.0 UG 0 0 0 eth3<br />
Run following commands:<br />
/sbin/route add -net 129.57.160.0 netmask 255.255.255.0 gw 129.57.160.5 dev eth1<br />
/sbin/route add -net 129.57.68.0 netmask 255.255.255.0 gw 129.57.68.26 dev eth3<br />
/sbin/route add -net 129.57.69.0 netmask 255.255.255.0 gw 129.57.69.206 dev dev5937<br />
/sbin/route add -net 129.57.64.0 netmask 255.255.255.0 gw 129.57.64.57 dev eth0<br />
Now ''route -n'' shows following:<br />
Kernel IP routing table<br />
Destination Gateway Genmask Flags Metric Ref Use Iface<br />
129.57.160.0 129.57.160.5 255.255.255.0 UG 0 0 0 eth1<br />
129.57.160.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1<br />
129.57.68.0 129.57.68.26 255.255.255.0 UG 0 0 0 eth3<br />
129.57.68.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3<br />
129.57.69.0 129.57.69.206 255.255.255.0 UG 0 0 0 dev5937<br />
129.57.69.0 0.0.0.0 255.255.255.0 U 0 0 0 dev5937<br />
129.57.64.0 129.57.64.57 255.255.255.0 UG 0 0 0 eth0<br />
129.57.64.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0<br />
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3<br />
0.0.0.0 129.57.68.100 0.0.0.0 UG 0 0 0 eth3<br />
In that example automount will do configured using ''clonmon-daq1'' interface, because default ''clonmon'' interface is on external subnet. To make that routing table permanent (retore it after reboot) I tried to add four files with following contents to the ''/etc/sysconfig/network-scripts'' directory:<br />
route-eth1:<br />
GATEWAY0=129.57.160.5<br />
NETMASK0=255.255.255.0<br />
ADDRESS0=129.57.160.0<br />
route-eth3:<br />
GATEWAY0=129.57.68.26<br />
NETMASK0=255.255.255.0<br />
ADDRESS0=129.57.68.0<br />
route-dev5937:<br />
GATEWAY0=129.57.69.206<br />
NETMASK0=255.255.255.0<br />
ADDRESS0=129.57.69.0<br />
route-eth0:<br />
GATEWAY0=129.57.64.57<br />
NETMASK0=255.255.255.0<br />
ADDRESS0=129.57.64.0<br />
It did not worked. Then I added four ''/sbin/route add ..'' lines to ''/etc/rc.local'' script, and it worked.<br />
<br />
From now on you can use remote 'ssh' connection.<br />
<br />
* To configure your system to use the patch server, issue the following commands as root:<br />
# mount jlabsite:/site /mnt<br />
# /mnt/CC/linux/satellite-connect --patchall<br />
The script will prompt you for an activation key, but if you don't know what this is, just hit ENTER and it will use a sensible default. Depending on how many patches need to be applied to your system to bring it up to the current level, this script may take a very long time to run. When it finishes, you should reboot your machine to make the new patches take effect.<br />
<br />
To install updates later run ''up2date -uf'' as ''root''.<br />
<br />
Configure [[SSH]].<br />
<br />
* Proceed with [[Linux Customization on CLON Cluster]] if applicable.<br />
<br />
To boot Linux in single user mode (no graphics), add ''single'' to the end of boot line during boot process.<br />
<br />
<br />
<br />
== '''background info''' ==<br />
<br />
'''Add startup script'''<br />
<br />
Create script in ''/etc/init.d/'' directory (use existing scripts as example). Must have a line like<br />
# chkconfig: - 91 09<br />
which specifies start and stop order. Run commands<br />
chkconfig --add <scriptname><br />
chkconfig --level 3 <scriptname> on<br />
for every level you want that script to be executed (usualy 3 and/or 4 and/or 5). Check if it os done using command<br />
chkconfig --list | grep <scriptname><br />
<br />
<br />
'''xxx'''<br />
<br />
You can choose to download the RHEL operating system directly from the Red Hat Web site and not receive a media kit from HP containing the software. This scenario occurs when the media option AJR is deselected from the order. (The media kit option is always selected by default. )<br />
<br />
It is necessary to register at the Red Hat Web site prior to download. Registration requires the activation code that each customer receives from HP when ordering either RHEL.<br />
<br />
You can download RHEL for each available platform as four CD ISO images or one DVD ISO image.<br />
<br />
Use the following procedure to download RHEL and create the installation media:<br />
<br />
1.<br />
<br />
Register and log in at the following Red Hat Web site:<br />
<br />
www.redhat.com/rhn<br />
2.<br />
<br />
Click on channels and then select Red Hat Enterprise Linux ES (v.4 for 64–bit Intel Itanium).<br />
3.<br />
<br />
Select Downloads and then download the ISO images of install, compatibility and source disks<br />
<br />
Files with ia64 in the name are for the Itanium platform.<br />
4.<br />
<br />
Create the CDs or a DVD from the ISO images.<br />
<br />
<br />
IMPORTANT: Create the CDs or DVD using the contents of the ISO images. Do not create the CDs or DVD by burning the .iso files themselves to CD or DVD. For example, if you are using K3b to burn a CD, click Tools>CD>Burn CD Image, select the .iso image, then click Burn.<br />
<br />
'''Bootup scripts''' for example for level 5 execution (multiuser with X):<br />
<br />
cp <script-file> /etc/init.d/<br />
chmod +x /etc/init.d/<script-file><br />
ln -s /etc/init.d/<scriptfile> /etc/rc.d/rc5.d/S50<scriptfile><br />
ln -s /etc/init.d/<scriptfile> /etc/rc.d/rc5.d/K50<scriptfile><br />
<br />
<br />
'''Changing hostname/IP address'''<br />
<br />
Changing hostname on RHEL<br />
1. Change the HOSTNAME line in /etc/sysconfig/network<br />
2. Change the hostname (FQDN and alias) in /etc/hosts<br />
3. Run '/bin/hostname new_hostname' for the hostname change to take effect immediately.<br />
4. Run '/sbin/service syslog restart' for syslog to log using the new hostname.<br />
A reboot is not required to change the system hostname.<br />
<br />
IP address: You have to change the IP address entry in<br />
/etc/sysconfig/network-scripts/ifcfg-eth0.</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=Yum&diff=8811
Yum
2026-09-11T19:42:46Z
<p>Boiarino: </p>
<hr />
<div>== yum/dnf at jlab ==<br />
<br />
'''NOTE: file ''/etc/dnf/plugins/subscription-manager.conf'' contains by default line ''disable_system_repos=1'', which makes all repositories defined outside redhat.repo to be disabled'''<br />
<br />
<br />
<br />
== OLD STUFF ==<br />
<br />
Useful commands:<br />
<br />
''repoquery -i itcl'' - tells which repository contains itcl package<br />
<br />
To remove package:<br />
<br />
yum --setopt=tsflags=noscripts remove <package><br />
<br />
Sometimes it is useful to delete some files:<br />
<br />
rm -f /var/lib/rpm/__db.*<br />
<br />
'''On CensOS on VTP, it was some problem:'''<br />
<br />
Hi Bryan,<br />
on yum updates, I tried<br />
[base]<br />
name=CentOS-$releasever - Base<br />
baseurl=http://vault.centos.org/altarch/$releasever/os/$basearch/<br />
and it gives me this:<br />
http://vault.centos.org/altarch/7/os/armhfp/repodata/repomd.xml: [Errno 14] HTTPS Error 301 - Moved Permanently<br />
Trying other mirror.<br />
If I change 'http:' to 'https:' it gives me this:<br />
https://vault.centos.org/altarch/7/os/armhfp/repodata/repomd.xml: [Errno 14] curl#60 - "Peer's certificate issuer has been marked as not trusted by the user."<br />
Trying other mirror.<br />
I added key<br />
sslverify=0<br />
on the next line after https:... and yum seems updating now, will see.<br />
Sergey<br />
<br />
Final ''/etc/yum.repos.d/CentOS-Base.repo'' looks like this ($releasever=7 and $basearch=armhfp):<br />
<br />
[base]<br />
name=CentOS-$releasever - Base<br />
baseurl=https://vault.centos.org/altarch/$releasever/os/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#released updates <br />
[updates]<br />
name=CentOS-$releasever - Updates<br />
baseurl=https://vault.centos.org/altarch/$releasever/updates/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#additional packages that may be useful<br />
[extras]<br />
name=CentOS-$releasever - Extras<br />
baseurl=https://vault.centos.org/altarch/$releasever/extras/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32<br />
<br />
#additional packages that extend functionality of existing packages<br />
[centosplus]<br />
name=CentOS-$releasever - Plus<br />
baseurl=https://vault.centos.org/altarch/$releasever/centosplus/$basearch/<br />
sslverify=0<br />
gpgcheck=1<br />
enabled=1<br />
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7<br />
file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-AltArch-Arm32</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8810
ATCA
2026-09-10T19:52:49Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
(names bayX.Y are defined in /etc/minirc.bayX.Y).<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8809
ATCA
2026-09-10T18:58:16Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DPM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8808
ATCA
2026-09-10T18:56:51Z
<p>Boiarino: /* ATCA electronics for HPS run designed in SLAC */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info''': tftpboot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8807
ATCA
2026-09-10T18:56:27Z
<p>Boiarino: </p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
'''Booting info'''<br />
<br />
Tftp boot from clon01, directory ''/tftpboot/slac-install/boot'', contains kernel and 3 subdirectories containing files fpga.bit and devicetree.dtb. Subdirectory names DTM, ctrlDPM and dataDPM are set in computer center dhcp config file and available in bootloader as ''rootpath''. Root tree is located on clonfs1 file server in directory /vol/diskless/ArchLinux/zynq_slac for nfs-mount.<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8806
ATCA
2026-09-10T18:48:20Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* usb connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bayX.Y # bay <N>.<RCE>, see below<br />
<br />
To reboot any DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8805
ATCA
2026-09-10T18:46:16Z
<p>Boiarino: /* DTMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* connection to COB blade from root@clondaq10 (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why''')<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8804
ATCA
2026-09-10T18:45:06Z
<p>Boiarino: /* ATCA electronics for HPS run designed in SLAC */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom from root@clondaq9:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8803
ATCA
2026-09-10T18:35:56Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
saveenv<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8802
ATCA
2026-09-10T18:18:29Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm11:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8801
ATCA
2026-09-10T18:17:41Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm9:<br />
minicom bay0.2<br />
./cob_rce_reset atca1/2/0/2<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm12:<br />
minicom bay1.2<br />
./cob_rce_reset atca1/2/1/2<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm13:<br />
minicom bay2.2<br />
./cob_rce_reset atca1/2/2/2<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
dpm15:<br />
minicom bay3.2<br />
./cob_rce_reset atca1/2/3/2<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8800
ATCA
2026-09-10T18:03:04Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
<br />
* to convert old bootloader to the new one do this:<br />
<br />
setenv kernel_path 'slac-install'<br />
setenv modeboot 'tftp_boot'<br />
setenv nfsargs 'setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp'<br />
setenv nfsload<br />
setenv tftp_load 'tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}'<br />
setenv nfsboot<br />
setenv tftp_boot 'dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000'<br />
setenv nfsip '129.57.167.152'<br />
setenv nfspath 'vol/diskless/ArchLinux/zynq_slac'<br />
setenv nfsfpga 'tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}'<br />
<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8799
ATCA
2026-09-10T17:58:26Z
<p>Boiarino: /* DTMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1917/131068 bytes<br />
zynq-uboot><br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
<br />
<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8798
ATCA
2026-09-10T17:43:30Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
enable-tftp=enp16s0f0<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${devicetree_image}<br />
<br />
Environment size: 1893/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm8:<br />
minicom bay0.0<br />
./cob_rce_reset atca1/2/0/0<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
<br />
<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8797
ATCA
2026-09-10T17:41:14Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
enable-tftp=enp16s0f0<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${devicetree_image}<br />
<br />
Environment size: 1893/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm10:<br />
minicom bay1.0<br />
./cob_rce_reset atca1/2/1/0<br />
<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
<br />
<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino
https://clonwiki0.jlab.org/wiki/index.php?title=ATCA&diff=8796
ATCA
2026-09-10T17:38:30Z
<p>Boiarino: /* DPMs */</p>
<hr />
<div>== ATCA electronics for HPS run designed in SLAC ==<br />
<br />
* packages needed:<br />
<br />
yum install cppzmq-devel<br />
<br />
* SLAC confluence instructions for [https://confluence.slac.stanford.edu/display/hpsg/EEL+Setup EEL Setup]<br />
<br />
* serial connection to atca1 crate: connect atca's serial port to computer USB using appropriate adapter, and use minicom:<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
root/HpsRoot<br />
# reboot <- will recycle atca crate power<br />
<br />
#ifconfig eth0 down<br />
#ifconfig eth0 up 129.57.86.147<br />
<br />
* atca crate is connected to the power strip, following command will recycle power:<br />
<br />
roc_reboot atca1<br />
<br />
* ethernet connection to atca1 crate:<br />
<br />
ssh -o RSAMinSize=1024 -o HostKeyAlgorithms=+ssh-rsa root@atca1<br />
<br />
<br />
== DTMs ==<br />
<br />
* serial connection to COB blade (port labeled 'console', need usb-micro cable; '''NOTE: some cables we tried were not good, not sure why'''<br />
<br />
minicom -D /dev/ttyUSB0 (set 115200 8N1)<br />
<br />
* DTM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1527/131068 bytes<br />
zynq-uboot> <br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
baudrate=115200<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
dnsip=129.57.90.255<br />
enable-tftp=enp16s0f0<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:0d<br />
fileaddr=2a00000<br />
filesize=2a1d<br />
gatewayip=129.57.86.1<br />
hostname=dtm1<br />
ipaddr=129.57.86.180<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
netmask=255.255.255.0<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rootpath=slac-install<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
serverip=129.57.167.4<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${devicetree_image}<br />
<br />
Environment size: 1893/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
== DPMs ==<br />
<br />
* serial connection to DPMs: ssh dtm1 as root/root, and from there, run<br />
<br />
minicom bay3.0 # bay <N>.<RCE> → bay 3, RCE 0<br />
<br />
To reboot that DPM, run following on regular server:<br />
<br />
cd /usr/clas12/release/1.4.0/slac_svt_new/V3.4.0/i86-linux-64/bin/<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
'''DPM's list''':<br />
<br />
dpm12:<br />
minicom bay2.0<br />
./cob_rce_reset atca1/2/2/0<br />
<br />
dpm14:<br />
minicom bay3.0<br />
./cob_rce_reset atca1/2/3/0<br />
<br />
<br />
<br />
<br />
<br />
<br />
* DPM old (nfs-based) bootloader:<br />
<br />
zynq-uboot> <br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
loadbit=0<br />
modeboot=nfsboot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${serverip}:${rootpath} ip=dhcp<br />
nfsboot=dhcp && run nfsload && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
nfsfpga=nfs 0x1000000 ${rootpath}/boot/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsload=nfs 0x3000000 ${rootpath}/boot/${kernel_image} && nfs 0x2A00000 ${rootpath}/boot/${devicetree_image}<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && boot0<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
<br />
Environment size: 1511/131068 bytes<br />
zynq-uboot> <br />
<br />
<br />
<br />
<br />
* DTM new (tftp-based) bootloader:<br />
<br />
zynq-uboot> printenv<br />
autoload=no<br />
bootcmd=run $modeboot<br />
bootdefs=console=ttyPS0,115200 rw rootwait earlyprintk<br />
bootdelay=3<br />
devicetree_image=devicetree.dtb<br />
ethact=Gem.e000b000<br />
ethaddr=08:00:56:00:46:09<br />
kernel_image=uImage<br />
kernel_path=slac-install<br />
loadbit=0<br />
modeboot=tftp_boot<br />
nfsargs=setenv bootargs ${bootdefs} root=/dev/nfs nfsroot=${nfsip}:${nfspath}/${rootpath},vers=3,proto=tcp ip=dhcp<br />
nfsfpga=tftpboot 0x1000000 ${kernel_path}/boot/${rootpath}/fpga.bit && fpga loadb 0 0x1000000 ${filesize}<br />
nfsip=129.57.167.152<br />
nfspath=vol/diskless/ArchLinux/zynq_slac<br />
phycfg=0x1<br />
ramdisk_devicetree=devicetree_ramdisk.dtb<br />
ramdisk_image=uramdisk.image.gz<br />
ramdisk_kernel=uImage<br />
ramdisk_rootfs=/dev/ram<br />
rtems_image=urtems.elf<br />
sd_rootfs=/dev/mmcblk0p3<br />
sdboot_linux=setenv modeboot sdboot_linux && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${kernel_image} && fatload mmc 0:7 0x2A00000 ${devicetree_image} && bootm 0x3000000 - 0x2A00000<br />
sdboot_rdisk=setenv modeboot sdboot_ramdisk && echo Copying Linux from SD to RAM... && mmcinfo && fatload mmc 0:7 0x3000000 ${ramdisk_kernel} && fatload mmc 0:7 0x2A00000 ${ramdisk_devicetree} && fatload mmc 0:7 0x2000000 ${ramdisk_image} && bootm 0x3000000 0x2000000 0x2A00000<br />
sdboot_rtems=echo Copying RTEMS from SD to RAM... && mmcinfo && fatload mmc 0:5 0x3000000 ${rtems_image} && bootm 0x3000000<br />
stderr=serial<br />
stdin=serial<br />
stdout=serial<br />
tftp_boot=dhcp && run tftp_load && run nfsargs && bsir && run nfsfpga && bsic && bootm 0x3000000 - 0x2A00000<br />
tftp_load=tftpboot 0x3000000 ${kernel_path}/boot/${kernel_image} && tftpboot 0x2A00000 ${kernel_path}/boot/${rootpath}/${devicetree_image}<br />
<br />
Environment size: 1685/131068 bytes<br />
zynq-uboot><br />
<br />
== some old stuff ==<br />
<br />
<br />
* DTMs/DPMs nfs mount<br />
<br />
''Clonfarm1'' machine is used as file server for DTMs/DPMs, because they are not supporting newer nfs versions required by modern file servers like ''clonfs1''.<br />
Make sure nfs server is set and running on ''clonfarm1''. File ''/etc/exports'' suppose to contain following lines:<br />
<br />
/data/hps/slac_svt/daq 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
#/data/hps/slac_svt/cache 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/server 129.57.0.0/16(rw,sync,no_subtree_check,no_root_squash)<br />
/data/hps/slac_svt/diskless 129.57.0.0/16(rw,insecure,async,no_subtree_check,no_root_squash)<br />
<br />
Run following to make sure, restart if needed:<br />
<br />
systemctl status rpcbind<br />
systemctl status nfs-server<br />
<br />
<br />
* DTMs/DPMs boot<br />
<br />
They are dhcp-boot devices, all settings are done by jlab computer center (Carl Bolitho). After boot, check it by logging in, for example ''ssh root@dtm1'' with pass ''root'' (be patient, may take some seconds to login).<br />
<br />
<br />
* some useful scripts in ''$CLAS/slac_svt/svtdaq/daqV2/rceScripts/:<br />
<br />
reboot_cobs.sh - crate power recycle<br />
shutdown_cobs.sh - turn power off (can be turned back on by reboot_cobs.sh)<br />
rem_udp_server.sh - ... (have to run it)<br />
rem_control_server.sh - start GUI server<br />
start_gui.sh - start gui<br />
<br />
== EEL building test setup ==<br />
<br />
machine used: clondaq10 with TIPCIe card to connect atca blades, and svt3 as master if clondaq10 is slave<br />
run as 'hpsrun', pass the same as clasrun<br />
EXPID=hpsrun, SESSION=clastest10<br />
coda config: clondaq10_er, svt3_clondaq10_er (rol1=hpssvt1_master.so or hpssvt1_slave.so, rol2=rol2.so)<br />
trigger files: HPS/EEL2021/hps_v1_noThr_TOPRCE_TIMaster.trg, HPS/EEL2021/hps_v1_noThr_TOPRCE_VMEMaster.trg<br />
data files monitoring: $CODA/src/bosio/main/evio_hpssvthist.c, kumac hps.kumac<br />
<br />
Cable TIPCIe-ATCA blade pinout ('new' TIPCIe):<br />
<br />
signal tipcie(40-pin) atca(26-pin)<br />
-------------------------------------------------<br />
syncreset 1/2 ---> 3/4<br />
trigger 3/4 ---> 5/6<br />
busy 17/18 <--- 11/12<br />
clock 39/40 ---> 7/8<br />
<br />
== Login and use of the test setup at SLAC ==<br />
<br />
<br />
Tunneling to and starting VNC server at SLAC:<br />
<br />
ssh -L 5905:localhost:1234 jlabl1<br />
ssh -L 1234:localhost:5905 rdsrv117.slac.stanford.edu<br />
vncserver :5 -geometry 1800x1000 -localhost -nolisten tcp<br />
top<br />
<br />
vncserver -kill :5<br />
<br />
<br />
To have write access on develpc:<br />
<br />
ssh clasrun@develpc<br />
sudo tcsh<br />
<br />
<br />
Running DAQ:<br />
<br />
clasrun account can get root access with:<br />
sudo bash<br />
<br />
ssh clasrun@slac1<br />
killall runcontrol rcServer rocs (cleanup just in case)<br />
runcontrol -rocs -log<br />
click on "rocs" tab on the right-top of the screen to observe built-in xterms<br />
click "Configure", pick configuration "slac", processes have to be started in xterms<br />
click "Download" and pick trigger file "slac1.trg"<br />
click "Prestart"<br />
click "Go"<br />
<br />
* trigger file "slac1.trg" is located in default directory<br />
$CLON_PARMS/trigger/. It contains electronics settings overloading<br />
defaults from $CLON_PARMS/ti, $CLON_PARMS/fadc250/ etc. In particular<br />
TI_RANDOM_TRIGGER 1 3<br />
enables TI internal random pulser with prescale 2**3, with prescale 3<br />
event rate will be about 50kHz.<br />
<br />
<br />
Rogue GUI:<br />
<br />
ssh clasrun@develpc<br />
bash<br />
cd /u1/hps/server/heavy-photon-daq/software<br />
conda activate rogue-hps-dev-rth<br />
python scripts/SvtCodaRun.py<br />
<br />
<br />
Reboot RCE:<br />
<br />
source /u1/hps/setup_env.sh<br />
cob_rce_reset dev-crate1-sm/2<br />
<br />
RCE boot status:<br />
<br />
cob_dump -rce dev-crate1-sm<br />
<br />
<br />
Log files if SLAC guys running daq:<br />
<br />
/home/clasrun/Xterm.log.slac1.2019.06.07.14.44.29.pE87M0</div>
Boiarino