OpenSceneGraph Forum Forum Index OpenSceneGraph Forum
Official forum which mirrors the existent OSG mailing lists. Messages posted here are forwarded to the mailing list and vice versa.
 
   FAQFAQ    SearchSearch    MemberlistMemberlist    RulesRules    UsergroupsUsergroups    RegisterRegister 
 Mail2Forum SettingsMail2Forum Settings  ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 
   AlbumAlbum  OpenSceneGraph IRC ChatOpenSceneGraph IRC Chat   SmartFeedSmartFeed 

vpbmaster build question...


 
Post new topic   Reply to topic    OpenSceneGraph Forum Forum Index -> VirtualPlanetBuilder [vpb]
View previous topic :: View next topic  
Author Message
S2LR
Appreciator


Joined: 13 Nov 2010
Posts: 208

PostPosted: Mon Jan 31, 2011 11:43 pm    Post subject:
vpbmaster build question...
Reply with quote

All,

I fired off a VPB build using vpbmaster on a 16 processor machine running Linux Fedora core 13. The number of tasks generated was 5314 for this build. As predicted, vpbmaster fired off 16 osgdem threads to work on the build.

As the build went along I noticed that the number of osgdem threads running had slowly decreased until that now there are only 0 to 2 threads running with about 2500 tasks remaining. I never see any more osgdem threads than 2 being generated to work on the build. This seems a bit strange.

Is this correct behavior? I would have thought that up to 16 threads would have been working as the build process went along to completion. There is no indication of any errors in the output so far.

Has anyone else seen this or know what might be going on?

Thank you!
-Shayne
Back to top
View user's profile Send private message
robertosfield
OSG Project Lead


Joined: 18 Mar 2009
Posts: 12264

PostPosted: Tue Feb 01, 2011 8:58 am    Post subject:
vpbmaster build question...
Reply with quote

Hi Shayne,

It sounds like VPB is black listing cores due to errors on the tasks
that ran on these cores, so it's limiting the build to just the ones
that are working. VPB does this to handle outages on a network build
where problems on a single machine don't bring the whole build to a
halt.

If it is black listing that is limiting the cores that are available
then you'll need to look at the logs to see if there have been any
failures and any reports of blacklisting. You will find a logs
directory in the directory that you ran the build from and within this
there will be lots of separate .log files that will provide the output
from each osgdem run, one per task.

If it isn't black listing then you'll need to try running vpbmaster in
a debugger and see what is going w.r.t threading.

Robert.

On Mon, Jan 31, 2011 at 11:43 PM, Shayne Tueller
<> wrote:
Quote:
All,

I fired off a VPB build using vpbmaster on a 16 processor machine running Linux Fedora core 13. The number of tasks generated was 5314 for this build. As predicted, vpbmaster fired off 16 osgdem threads to work on the build.

As the build went along I noticed that the number of osgdem threads running had slowly decreased until that now there are only 0 to 2 threads running with about 2500 tasks remaining. I never see any more osgdem threads than 2 being generated to work on the build. This seems a bit strange.

Is this correct behavior? I would have thought that up to 16 threads would have been working as the build process went along to completion. There is no indication of any errors in the output so far.

Has anyone else seen this or know what might be going on?

Thank you!
-Shayne

------------------
Read this topic online here:
http://forum.openscenegraph.org/viewtopic.php?p=36210#36210









------------------
Post generated by Mail2Forum
Back to top
View user's profile Send private message
S2LR
Appreciator


Joined: 13 Nov 2010
Posts: 208

PostPosted: Tue Feb 01, 2011 3:06 pm    Post subject:
vpbmaster build question...
Reply with quote

Thanks Robert.

I'll investigate the logs and report my findings...

-Shayne

-----Original Message-----
From:
[mailto:] On Behalf Of Robert
Osfield
Sent: Tuesday, February 01, 2011 1:59 AM
To:
Subject: Re: [vpb] vpbmaster build question...

Hi Shayne,

It sounds like VPB is black listing cores due to errors on the tasks
that ran on these cores, so it's limiting the build to just the ones
that are working. VPB does this to handle outages on a network build
where problems on a single machine don't bring the whole build to a
halt.

If it is black listing that is limiting the cores that are available
then you'll need to look at the logs to see if there have been any
failures and any reports of blacklisting. You will find a logs
directory in the directory that you ran the build from and within this
there will be lots of separate .log files that will provide the output
from each osgdem run, one per task.

If it isn't black listing then you'll need to try running vpbmaster in
a debugger and see what is going w.r.t threading.

Robert.

On Mon, Jan 31, 2011 at 11:43 PM, Shayne Tueller
<> wrote:
Quote:
All,

I fired off a VPB build using vpbmaster on a 16 processor machine running
Linux Fedora core 13. The number of tasks generated was 5314 for this build.
As predicted, vpbmaster fired off 16 osgdem threads to work on the build.
Quote:

As the build went along I noticed that the number of osgdem threads
running had slowly decreased until that now there are only 0 to 2 threads
running with about 2500 tasks remaining. I never see any more osgdem threads
than 2 being generated to work on the build. This seems a bit strange.
Quote:

Is this correct behavior? I would have thought that up to 16 threads would
have been working as the build process went along to completion. There is no
indication of any errors in the output so far.
Quote:

Has anyone else seen this or know what might be going on?

Thank you!
-Shayne

------------------
Read this topic online here:
http://forum.openscenegraph.org/viewtopic.php?p=36210#36210











------------------
Post generated by Mail2Forum
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    OpenSceneGraph Forum Forum Index -> VirtualPlanetBuilder [vpb] All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Similar Topics
Topic Author Forum Replies Posted
No new posts Question about method of building osgQt trexmsuee Build system [build] 1 Thu Apr 11, 2019 2:22 pm View latest post
No new posts Really basic question light/material ... dhhabyc General 0 Tue Apr 09, 2019 4:53 pm View latest post
No new posts Particular Build Problems with OSG. Zachary1234 Build system [build] 5 Wed Mar 27, 2019 7:12 am View latest post
No new posts Question about linking OSG 3D content... Zachary1234 General 0 Mon Mar 25, 2019 6:14 am View latest post
No new posts Help about obtaining a particular OSG... Zachary1234 General 4 Sat Mar 02, 2019 11:33 am View latest post


Board Security Anti Bot Question MOD - phpBB MOD against Spam Bots
Powered by phpBB © 2001, 2005 phpBB Group
Protected by Anti-Spam ACP