Page 1 of 8 123 ... LastLast
Results 1 to 20 of 150

Thread: Guide to running the client on multiple NV GPUs

  1. #1
    Join Date
    Jun 2008
    Location
    The Netherlands
    Posts
    33

    Guide to running the client on multiple NV GPUs

    HOW-TO: Multi NV GPU2 Clients on 2+ GPUs

    Welcome to this mini-guide to running the Folding@Home Nvidia GPU2 Client on your multi-GPU setup.
    With the release of Client Core 1.0.7, this process became a little easier - however there are still several things to be aware of.

    First of all, this new core will not yet download automatically - you have to go to the above topic and get it yourself, then copy it into the %AppData% FAH folder and overwrite the old core.
    Secondly, if you are on Windows Vista, you will need to connect a monitor to each card you want to fold with, and extend the desktop onto all of those monitors.
    This is the consequence of a Microsoft policy, and Nvidia can't fix it without breaking that policy. More information here.
    I'm currently looking into finding a way to get around this, but be aware that I will be on holiday from the 4th of July (this Friday) to the 5th of August.
    This means I won't have a CUDA-capable computer to test with, but I'll try to figure something out regardless.

    If you're on Windows XP or have at least two monitors to play with, take the following steps to get multi-GPU support working:
    (If you already had a go at this with core 1.0.7, make sure you don't have the NV_FAH_DEVICE environment variable set.
    This setting will overwrite the -gpu parameter. If you don't know what I'm talking about, don't worry about it)

    1: Switch from Multi-GPU to Multi-Display mode: (this may require a reboot)


    2: Make as many copies of the Folding@Home-gpu folder in %ProgramFiles%/%ProgramFiles(x86) as you have cards:
    (note: %ProgramFiles(x86)% is only used on 64-bit versions of Windows; don't confuse the two!)


    3: Make as many copies of the Folding@Home-gpu folder in %AppData% as you have cards:
    (note there will be more folders in there than just the FAH ones - I edited mine out for simplicity)


    4: The client.cfg (located in the %AppData% folders, but only after you've run the client at least once) will set your machine ID to '2' by default.
    You will need to change this so that FAH will be able to communicate with the server properly. (for instance just use 2, 3, 4 and 5 if you have Quad SLI)

    5: Make shortcuts to the copies of FAH you made in %ProgramFiles%/%ProgramFiles(x86)%:

    Note the '-gpu 0' parameter: change this to '-gpu 1' for the second card, '-gpu 2' for the third and so on. There needs to be a space between the -gpu part and the number.
    Don't forget to set the 'Start in' location as above! (but use the appropriate copy)

    And you're done!

    PS: in this guide I chose to rename the original FAH folders to 'Folding@Home-gpu 1' for the sake of consistency. This isn't necessary, I just think it looks less confusing.

  2. #2
    Join Date
    Mar 2007
    Location
    Big D
    Posts
    5,477
    EXCEPTIONAL First post!

    Welcome to XCPUs and thanks for the informative How-To.
    1: Main Rig - eVGA Classified SR-2 | 2 x Xeon X5670 @ 4.05GHz | 12GB Mushkin PC3-1600 DDR3 | OCZ IBIS 240GB RAID SSD | ATI Radeon 5770 1GB | Dual Dell 3007WFP-HC Monitors
    2: Server - eVGA X58 SLI | L5640 @ 4GHz | 6GB OCZ PC3-1866 DDR3 | Intl X25-M G2 80GB OS Drive | 6 x 1.5TB Seagate 7200.11 RAID 10



  3. #3
    Join Date
    Jun 2007
    Location
    Ontario, Canada
    Posts
    3,096
    so, would Melty be the only one with this card here?
    interesting.. at least the nVidia dual GPU card can be used now (ATI's 3870x2 still can't use the 2nd core)

    welcome aboard!

  4. #4
    Join Date
    Mar 2007
    Location
    Big D
    Posts
    5,477
    I'll have a pair or 3 8800GTs by the end of the week to test it out.
    1: Main Rig - eVGA Classified SR-2 | 2 x Xeon X5670 @ 4.05GHz | 12GB Mushkin PC3-1600 DDR3 | OCZ IBIS 240GB RAID SSD | ATI Radeon 5770 1GB | Dual Dell 3007WFP-HC Monitors
    2: Server - eVGA X58 SLI | L5640 @ 4GHz | 6GB OCZ PC3-1866 DDR3 | Intl X25-M G2 80GB OS Drive | 6 x 1.5TB Seagate 7200.11 RAID 10



  5. #5
    Join Date
    Jun 2007
    Location
    Three Mile Island
    Posts
    8,012
    I can't seem to get this to work in Vista x64. Do you know of any limitations with regard to Vista in general or the 64-bit OS in particular with this technique?

    If I use the standard cudart.dll, both clients will start but it's only using one GPU. With your .dll file I get an error as shown attached. I'm using a 9800GX2 as well if that matters, and I actually have two of them which I could put in the same machine to test quad-clients once I can get two clients to work together nicely.
    Attachment 911
    Sailer: Its a long commute, after all. Got to do something to relieve the monotony of the bumper to bumper traffic, like revving up the engine and listen to the supercharger whine.

  6. #6
    Join Date
    Mar 2007
    Location
    Big D
    Posts
    5,477
    Quote Originally Posted by MeltDown View Post
    I can't seem to get this to work in Vista x64. Do you know of any limitations with regard to Vista in general or the 64-bit OS in particular with this technique?
    Is the cudart.dll file the same revision in Vista64 and XP? That may need to be re-worked.
    1: Main Rig - eVGA Classified SR-2 | 2 x Xeon X5670 @ 4.05GHz | 12GB Mushkin PC3-1600 DDR3 | OCZ IBIS 240GB RAID SSD | ATI Radeon 5770 1GB | Dual Dell 3007WFP-HC Monitors
    2: Server - eVGA X58 SLI | L5640 @ 4GHz | 6GB OCZ PC3-1866 DDR3 | Intl X25-M G2 80GB OS Drive | 6 x 1.5TB Seagate 7200.11 RAID 10



  7. #7
    Join Date
    Jun 2008
    Location
    The Netherlands
    Posts
    33
    Thanks for the kind responses, guys; I hope you don't run into any problems

    Quote Originally Posted by brentpresley View Post
    Is the cudart.dll file the same revision in Vista64 and XP? That may need to be re-worked.
    Ah, 64-bit operating systems - that's one thing I didn't consider. If the FAH installer includes a 64-bit version of the cudart.dll, then I need a 64-bit OS to make the necessary changes. If it's the same dll however, then there may be something I can do.

  8. #8
    Join Date
    Jun 2007
    Location
    Three Mile Island
    Posts
    8,012
    I can send you the version of cudart.dll I have for Vista 64 if that will help you see if it's different.
    Sailer: Its a long commute, after all. Got to do something to relieve the monotony of the bumper to bumper traffic, like revving up the engine and listen to the supercharger whine.

  9. #9
    Join Date
    Jun 2008
    Location
    The Netherlands
    Posts
    33
    Sure, that would work. By the way, I may be able to persuade my parents that I need Vista x64 for my education (I study IT, so that's not entirely invalid) <.<

  10. #10
    Join Date
    Mar 2007
    Location
    Big D
    Posts
    5,477
    I can get you a 64-bit eval copy, should be good for like 30-days.
    1: Main Rig - eVGA Classified SR-2 | 2 x Xeon X5670 @ 4.05GHz | 12GB Mushkin PC3-1600 DDR3 | OCZ IBIS 240GB RAID SSD | ATI Radeon 5770 1GB | Dual Dell 3007WFP-HC Monitors
    2: Server - eVGA X58 SLI | L5640 @ 4GHz | 6GB OCZ PC3-1866 DDR3 | Intl X25-M G2 80GB OS Drive | 6 x 1.5TB Seagate 7200.11 RAID 10



  11. #11
    Join Date
    Jun 2007
    Location
    Three Mile Island
    Posts
    8,012
    I have to run to dinner, will be back shortly. Here's the file uploaded to rapidshare.
    RapidShare: Easy Filehosting
    Sailer: Its a long commute, after all. Got to do something to relieve the monotony of the bumper to bumper traffic, like revving up the engine and listen to the supercharger whine.

  12. #12
    Join Date
    Jun 2008
    Location
    The Netherlands
    Posts
    33
    The files are the same, so it's all done in 32-bits. Unfortunately I need to go to bed (it's already 2 AM here), but I'll see if I can dig something up tomorrow. I might ask you to try out a few test dlls with some debugging code added, if you don't mind. (I'll also consider getting a 64-bit OS - just reformatted so I'm not too keen on doing that again )

  13. #13
    Join Date
    Jun 2007
    Location
    Three Mile Island
    Posts
    8,012
    I have a partition with Vista 32 bit on it, I'll try with that while you get your rest.
    Sailer: Its a long commute, after all. Got to do something to relieve the monotony of the bumper to bumper traffic, like revving up the engine and listen to the supercharger whine.

  14. #14
    Join Date
    Dec 2007
    Location
    Hardeeville, SC
    Posts
    3,071
    After you get it worked out Meltdown, I'll give it a shot on my tri-sli setup. I'll need a copy of the modded cudart.dll file, too. Nice work Ver Greeneyes!
    Gamer: RV02 Custom Paint | i7 3930K 4.5GHz | 1337 H2O | 16GB DDR3 | Cooler Master Hybrid 1300W | GTX 680 | 240GB OCZ iBiS SSD | Windows 8 | EVGA X79 SLI
    HTPC/Server: Silverstone Case | Xeon L5640 | Stock Heatsink | 10GB DDR3 | Thermaltake 875W | GT 430 | 256GB Samsung SSD | 8 TB | Windows 8 | ASUS X58

    Nokia Lumia 920 Black
    [

  15. #15
    Join Date
    Mar 2007
    Location
    Big D
    Posts
    5,477
    I hope we get the kinks worked out. I wold love to deploy this to my farm and the supercomputer.
    1: Main Rig - eVGA Classified SR-2 | 2 x Xeon X5670 @ 4.05GHz | 12GB Mushkin PC3-1600 DDR3 | OCZ IBIS 240GB RAID SSD | ATI Radeon 5770 1GB | Dual Dell 3007WFP-HC Monitors
    2: Server - eVGA X58 SLI | L5640 @ 4GHz | 6GB OCZ PC3-1866 DDR3 | Intl X25-M G2 80GB OS Drive | 6 x 1.5TB Seagate 7200.11 RAID 10



  16. #16
    Join Date
    Jun 2008
    Location
    The Netherlands
    Posts
    33
    Oh, I just had a thought. Could you try this version? (only meant for 64-bit windows!) It's just a thought though, there's probably more to it. Anyway, bedtime for me.

  17. #17
    Join Date
    Jun 2007
    Location
    Three Mile Island
    Posts
    8,012
    That latest one still doesn't work for me. I'm going to try Vista 32 bit now.
    Sailer: Its a long commute, after all. Got to do something to relieve the monotony of the bumper to bumper traffic, like revving up the engine and listen to the supercharger whine.

  18. #18
    Join Date
    Jun 2007
    Posts
    8,966
    Now that, friend, is how to join a forum community with a bang!
    i7 920 D0 | MSI X58 Pro-E | Zotac GTX 275 | 3x2GB G.Skill DDR3-1333 9-9-9-24 | Corsair HX-520 | 640GB WD Caviar Black


  19. #19
    Join Date
    Jun 2007
    Location
    TX
    Posts
    1,889
    I don't have SLI... but very nice work so far on the dual nV clients. I'm looking forward to seeing the progress continue!
    Folding@Home: Fighting diseases 1 WU at a time.

    DFI LP Jr. P45 | Xeon X3320 | XFX 4770 | Corsair HX620 | Thermalright SI128SE | Other stuff | Lian-Li PC-V350B

  20. #20
    Join Date
    Jun 2008
    Location
    The Netherlands
    Posts
    33
    Alright. MeltDown, please try this version: cudart.dll
    It won't fix your problem, but it contains a lot of debugging code to help me identify it. It will create a debug.txt - could you post that here? (To anyone who wants to see what it outputs when it's working correctly, be careful - the thing grows very quickly)

    Edit: please try it for both device 0 and 1 (just edit device.txt), in case they behave differently.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •