Mac OS X Server Xgrid Administration and High Performance Computing For Version 10.5 Leopard Apple Inc. © 2007 Apple Inc. All rights reserved. The owner or authorized user of a valid copy of Mac OS X Server software may reproduce this publication for the purpose of learning to use such software. No part of this publication may be reproduced or transmitted for commercial purposes, such as selling copies of this publication or for providing paid-for support services. Every effort has been made to ensure that the information in this manual is accurate. Apple Inc. is not responsible for printing or clerical errors. Apple 1 Infinite Loop Cupertino, CA 95014-2084 408-996-1010 www.apple.com Use of the "keyboard" Apple logo (Option-Shift-K) for commercial purposes without the prior written consent of Apple may constitute trademark infringement and unfair competition in violation of federal and state laws. AirPort, Apple, the Apple logo, Bonjour, FireWire, iPod, Mac, Macintosh, Mac OS, Xgrid, Xsan, and Xserve are trademarks of Apple Inc., registered in the U.S. and other countries. Apple Remote Desktop and Finder are trademarks of Apple Inc. Intel, Intel Core, and Xeon are trademarks of Intel Corp. in the U.S. and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. and other countries. UNIX is a registered trademark of The Open Group. Other company and product names mentioned herein are trademarks of their respective companies. Mention of third-party products is for informational purposes only and constitutes neither an endorsement nor a recommendation. Apple assumes no responsibility with regard to the performance or use of these products. 019-0946/2007-09-01 1 Contents Preface 9 9 9 10 10 11 12 12 13 13 About This Guide What's New in Xgrid Administration What's in This Guide Using This Guide Using Onscreen Help Advanced Server Administration Guides Viewing PDF Guides on Screen Printing PDF Guides Getting Documentation Updates Getting Additional Information Part I Chapter 1 17 17 18 20 20 21 21 22 23 23 24 24 24 25 25 26 26 27 Xgrid Administration Introducing Xgrid Service About Xgrid and Computational Grids How Xgrid Works Common Types of Grids and Grid Computing Styles Xgrid Clusters Local Grids Distributed Grids Xgrid Components Agent Client Controller Jobs Requirements and Capacities Setting Up and Configuring Xgrid Service Setup Overview Before Setting Up Xgrid Service Authentication Methods for Xgrid Single Sign-On (SSO) Chapter 2 3 27 27 28 28 28 29 29 30 30 30 31 32 33 34 34 34 35 35 36 37 37 37 38 Chapter 3 39 39 40 40 40 41 41 41 42 43 43 44 44 44 44 45 45 45 46 Password-Based Authentication No Authentication Hosting the Grid Controller Turning Xgrid Service On Configuring Xgrid with the Xgrid Service Configuration Assistant Configuring Xgrid to Host a Grid Using the Xgrid Service Configuration Assistant Configuring Xgrid to Join a Grid Using Xgrid Service Configuration Assistant Setting Up Xgrid Service Xgrid and Multiple Network Interfaces Configuring Controller Settings Starting Xgrid Service Configuring an Xgrid Agent (Mac OS X Server) Configuring an Xgrid Agent (Mac OS X) Setting Up Grid Authentication Setting Up Kerberos for Xgrid Setting Passwords for Xgrid Managing Client Access Setting SACL Permissions for Users and Groups Setting SACL Permissions for Administrators Managing Xgrid Service Viewing Xgrid Service Status Viewing Xgrid Service Logs Stopping Xgrid Service Managing a Grid Using Xgrid Admin Status Indicators in Xgrid Admin Managing the Xgrid Controller Connecting to an Xgrid Controller Disconnecting from an Xgrid Controller Adding an Xgrid Controller Removing an Xgrid Controller Managing Agents Viewing a List of Agents Adding an Agent Deleting an Agent Managing Jobs Viewing a List of Jobs Stopping a Job Repeating or Restarting a Job Deleting a Job Adding a Grid Deleting a Grid 4 Contents 46 Chapter 4 47 47 47 48 48 48 49 49 51 51 51 52 52 53 53 53 53 54 55 Monitoring Grid Activity Planning and Submitting Xgrid Jobs Structuring Jobs for Xgrid About Job Styles About Job Failure Submitting a Job Examples of Xgrid Job Submission and Results Retrieval Viewing Job Status Retrieving Job Results Solving Xgrid Problems If Your Agents Can't Connect to the Xgrid Controller If You Use Xgrid over SSH If You Run Tasks on Multi-CPU Machines If You Submit a Large Number of Jobs If You Want to Use Xgrid on Other Platforms If the Xgrid Controller Must Be Restarted If Xgrid Has Crashed If You Are Trying to Submit Jobs over 2 GB If You Want to Enable Kerberos/SSO for Xgrid For More Information Chapter 5 Part II Chapter 6 59 59 59 60 60 60 62 63 64 67 67 67 67 68 68 72 Configuring High Performance Computing Introducing High Performance Computing Understanding HPC Apple and HPC Mac OS X Server Xserve Clusters Xserve 64-Bit Architecture Support of Loosely Coupled Computations Reviewing the Cluster Setup Process Cluster Setup Overview Identifying Prerequisites and System Requirements Prerequisites Expertise Xserve Configuration System Requirements Infrastructure Requirements Software Requirements Chapter 7 Chapter 8 Contents 5 72 73 Chapter 9 75 75 78 81 81 84 85 86 86 87 88 90 90 90 91 92 93 94 95 95 98 98 99 101 101 102 103 103 104 105 106 107 111 111 112 112 Private Network Requirements Static IP Address and Hostname Requirements Preparing the Cluster for Configuration Preparing the Cluster Nodes for Software Configuration (Optional) Setting Up the Management Computer Setting Up the Cluster Controller Setting Up Server Software on the Cluster Controller Configuring DNS Service Verifying DNS Settings Configuring Open Directory Service Configuring the Cluster Controller as an Open Directory Master Configuring DHCP Service Configuring Firewall Settings on the Cluster Controller Configuring NAT Settings on the Cluster Controller Configuring NFS Configuring VPN Service Configuring Xgrid Service Preparing the Data Drive as a Mirrored RAID set Creating a Home Directory Automount Share Point Creating User Accounts Setting Up Compute Nodes Creating an Auto Server Setup Record for Compute Nodes Verifying LDAP Record Creation Setting Up Compute Nodes Configuring Cluster Nodes Creating and Verifying a VPN Connection Joining a Remote Client to the Kerberos Realm Verifying Remote Client Access to the Kerberos Realm Testing Your Cluster Checking Your Cluster Using Xgrid Admin Testing Your Xgrid Cluster Verifying Your Xgrid Configuration Verifying Your SSH Connection Cluster Setup Checklist Automating Compute Node Configuration Naming Multiple Cluster Nodes Joining Multiple Cluster Nodes to the Kerberos Realm Configuring Xgrid Agent Settings Using Apple Remote Desktop Chapter 10 Chapter 11 Chapter 12 Appendix A Appendix B 6 Contents 114 Glossary Index 115 121 Using SSH Without Passwords Contents 7 8 Contents This guide describes the Xgrid components included in Mac OS X Server and tells you how to configure and use them in computational grids. Xgrid in Mac OS X Server version 10.5 includes a controller for computational grids and an agent that allows the server's processor to work on jobs submitted to a grid. The agent is also available in computers using Mac OS X v10.3 or v10.4. What's New in Xgrid Administration Xgrid service, Xgrid Admin, and high performance computing (HPC) in Mac OS X Server v10.5 Leopard include the following valuable new features.  Improved security with Xgrid superuser access controls  New Xgrid service configuration assistant  Logging improvements What's in This Guide This guide is organized as follows:  Part I--Xgrid Administration. The chapters in this part of the guide introduce you to Xgrid service and the applications and tools available for administering xgrid.  Part II--Configuring High Performance Computing. The chapters in this part of the guide introduce you to HPC and the applications and tools available for administering HPC. Note: Because Apple frequently releases new versions and updates to its software, images shown in this book may be different from what you see on your screen. Preface 9 About This Guide Using This Guide The following list contains suggestions for using this guide:  Read the guide in its entirety. Subsequent sections might build on information and recommendations discussed in prior sections.  The instructions in this guide should always be tested in a nonoperational environment before deployment. This nonoperational environment should simulate, as much as possible, the environment where the computer will be deployed. Using Onscreen Help You can get task instructions on screen in Help Viewer while you're managing Leopard Server. You can view help on a server or an administrator computer. (An administrator computer is a Mac OS X computer with Leopard Server administration software installed on it.) To get help for an advanced configuration of Leopard Server: m Open Server Admin or Workgroup Manager and then:  Use the Help menu to search for a task you want to perform.  Choose Help > Server Admin or Help > Workgroup Manager to browse and search the help topics. The help for Server Admin and Workgroup Manager contains instructions taken from Server Administration and other advanced administration guides described in "Advanced Server Administration Guides," next. To see the latest server help topics: m Make sure the server or administrator computer is connected to the Internet while you're getting help. Help Viewer automatically retrieves and caches the latest server help topics from the Internet. When not connected to the Internet, Help Viewer displays cached help topics. 10 Preface About This Guide Advanced Server Administration Guides Getting Started covers basic installation and initial setup methods for a standard, workgroup, or advanced configuration of Leopard Server. An advanced guide, Server Administration, covers advanced planning, installation, setup, and more. A suite of additional guides, listed below, covers advanced planning, setup, and management of individual services. You can get these guides in PDF format from the Mac OS X Server documentation website at www.apple.com/server/documentation. This guide ... Getting Started and Mac OS X Server Worksheet Command-Line Administration File Services Administration iCal Service Administration iChat Service Administration Mac OS X Security Configuration Mac OS X Server Security Configuration Mail Service Administration Network Services Administration Open Directory Administration Podcast Producer Administration Print Service Administration QuickTime Streaming and Broadcasting Administration Server Administration tells you how to: Install Mac OS X Server and set it up for the first time. Install, set up, and manage Mac OS X Server using UNIX commandline tools and configuration files. Share selected server volumes or folders among server clients using the AFP, NFS, FTP, and SMB/CIFS protocols. Set up and manage iCal shared calendar service. Set up and manage iChat instant messaging service. Make Mac OS X computers (clients) more secure, as required by enterprise and government customers. Make Mac OS X Server and the computer it's installed on more secure, as required by enterprise and government customers. Set up and manage IMAP, POP, and SMTP mail services on the server. Set up, configure, and administer DHCP, DNS, VPN, NTP, IP firewall, NAT, and RADIUS services on the server. Set up and manage directory and authentication services, and configure clients to access directory services. Set up and manage Podcast Producer service to record, process, and distribute podcasts. Host shared printers and manage their associated queues and print jobs. Capture and encode QuickTime content. Set up and manage QuickTime streaming service to deliver media streams live or on demand. Perform advanced installation and setup of server software, and manage options that apply to multiple services or to the server as a whole. Use NetBoot, NetInstall, and Software Update to automate the management of operating system and other software used by client computers. Use data and service settings from an earlier version of Mac OS X Server or Windows NT. Create and manage user accounts, groups, and computers. Set up managed preferences for Mac OS X clients. System Imaging and Software Update Administration Upgrading and Migrating User Management Preface About This Guide 11 This guide ... Web Technologies Administration Xgrid Administration and High Performance Computing Mac OS X Server Glossary tells you how to: Set up and manage web technologies, including web, blog, webmail, wiki, MySQL, PHP, Ruby on Rails, and WebDAV. Set up and manage computational clusters of Xserve systems and Mac computers. Learn about terms used for server and storage products. Viewing PDF Guides on Screen While reading the PDF version of a guide on scre ...