Skip to content
robnagler edited this page Jul 5, 2021 · 4 revisions

Blade server setup

Daisy chain CMC

When daisy-chaining chassis together, GB is the uplink port and STK is the stacking (cable consolidation) port. Connect the GB ports to the management network or to the STK port of CMC in a chassis that is closer to the network. You must connect the STK port only to a GB port further from the chain or network.

Using the LCD panel on the front of the system, provide CMC with a static IP address or configure it for DHCP.

Connect KVM, which talks to CMC. Login with root/calvin, and then enter:

racadm setniccfg -s 192.168.1.254 255.255.255.0 192.168.1.1

You can then access the web browser and login with root/calvin: https://192.168.1.254 (or https://127.0.0.1:2000/cgi-bin/webcgi/login if tunneled).

Set the root password for chassis management controller. Chassis Overview [left menu] > User Authentication [top tab] > Local Users [sub menu] > Click on "1" [button on "root" row].

  • Check "Change password"
  • Enter Password (twice)

Then go to Server Overview [left menu] > Setup [top tab] > iDrac [sub menu] > Quick Deploy Settings [below top menu].

  • Quick Deploy Enabled: checked
  • Enable iDRAC LAN: checked
  • Enable iDRAC IPv4: checked
  • Enable iDRAC IPMI over LAN: checked
  • Starting iDRAC IPv4 Address (Slot 1): 192.168.1.212
  • iDRAC IPv4 Netmask: 255.255.255.0
  • iDRAC IPv4 Gateway: 192.168.1.1

Click Save QuickDeploy Settings.

Below, click Auto-Populate Using QuickDeploy Settings

At bottom, click Apply iDRAC Network Settings to apply them to existing blades.

Power On CMC

Select Chassis Overview > Power > Control. This will power on the chassis when you click Apply. This powers on the MXL as well.

110v operation:

You must enable 110v operation, or the blades won't boot.

You can do this from the web interface:

Chassis Overview > Power > Configuration > Allow 110 VAC Operation > apply

Or ssh:

ssh root@ac1

Then Dell PowerEdge M1000e Chassis Management Controller Firmware (p215)

racadm config -g cfgChassisPower -o cfgChassisAllow110VACOperation 1

Verify that it was set:

$ racadm getconfig -g cfgChassisPower
# cfgChassisInPower=373 W (1272 BTU/h)
# cfgChassisPeakPower=813 W
# cfgChassisPeakPowerTimestamp=16:29:46 12/19/2015
# cfgChassisMinPower=88 W
# cfgChassisMinPowerTimestamp=19:46:33 12/18/2015
# cfgChassisPowerStatus=3
# cfgChassisRedundantState=1
cfgChassisPowerCap=16685 W
cfgChassisPowerCapF=16685 W
cfgChassisPowerCapBTU=56931 BTU/h
cfgChassisPowerCapFBTU=56931 BTU/h
cfgChassisPowerCapPercent=100 %
cfgChassisPowerCapFPercent=100 %
cfgChassisRedundancyPolicy=1
cfgChassisDynamicPSUEngagementEnable=0
# cfgChassisInMaxPowerCapacity=4328 W
# cfgChassisInRedundancyReserve=4328 W
# cfgChassisInPowerServerAllocation=256 W
# cfgChassisInfrastructureInPowerAllocation=229 W
# cfgChassisTotalInPowerAvailable=7587 W
# cfgChassisStandbyInPowerCapacity=0 W
# cfgChassisPowerClear=******** (Write-Only)
# cfgChassisPowerClearTimestamp=19:41:17 12/18/2015
cfgChassisPowerButtonEnable=1
cfgChassisAllow110VACOperation=16:13:19 12/19/2015
cfgChassisMaxPowerConservationMode=0
cfgChassisPerformanceOverRedundancy=1
# cfgSystemEnergyConsumptionClear=******** (Write-Only)
cfgChassisServerBasedPowerMgmtMode=0

Misc

http://tech.ryancox.net/2010/12/useful-commands-for-dell-servers.html

get BIOS.BiosBootSettings.HddSeq
set BIOS.BiosBootSettings.HddSeq Disk.SDInternal.1-1,RAID.Integrated.1-1
jobqueue create BIOS.Setup.1-1
serveraction hardreset

Dell System Update

Sets up DSU repo http://linux.dell.com/repo/hardware/dsu. This how to setup racadm on Linux:

yum install openssl098e.x86_64
curl -L -s -S http://linux.dell.com/repo/hardware/latest/bootstrap.cgi | bash

cfgChassisDynamicPSUEngagementEnable

Need to figure out if we should enable this or cfgChassisServerBasedPowerMgmtMode=0

Connect to the DRAC of an m620:

$ ssh root@a14c
root@a14c's password:
/admin1-> racadm
racadm>>racreset
RAC reset operation initiated successfully. It may take a few
 minutes for the RAC to come online again.
racadm>>exit
/admin1->exit

Watch for the DRAC to come back up:

$ ping a14c

Make sure server is booted:

serveraction powerstatus

You can autocomplete many commands. Not all values, though.

Serial over LAN (SOL)

RACADM Command Line Reference Guide iDRAC7 (p278):

set iDRAC.IPMILan.Enable 1

Optionally:

set iDRAC.IPMILan.AlertEnable 1

These command are committed immediately. The next ones require a "job queue".

RACADM Command Line Reference Guide iDRAC7 (p376):

set BIOS.SerialCommSettings.ConTermType Vt100Vt220
set BIOS.SerialCommSettings.RedirAfterBoot Enabled
set BIOS.SerialCommSettings.SerialPortAddress Com1
set BIOS.SerialCommSettings.SerialComm OnConRedir
set BIOS.SerialCommSettings.FailSafeBaud 115200

http://jonamiki.com/2014/10/18/racadm-change-bios-settings-create-commit-job-reboot-and-apply/ This command takes awhile:

jobqueue create BIOS.Setup.1-1 -r pwrcycle -s TIME_NOW -e TIME_NA

Check status:

jobqueue view

???? WHy doesn't job get executed on a14c?

Verify that it is set:

racadm>>get BIOS.SerialCommSettings

racadm get BIOS.SerialCommSettings
[Key=BIOS.Setup.1-1#SerialCommSettings]
ConTermType=Vt100Vt220
FailSafeBaud=115200
RedirAfterBoot=Enabled
SerialComm=OnConRedir
SerialPortAddress=Com1

racadm>>get iDRAC.IPMILan

racadm get iDRAC.IPMILan
[Key=iDRAC.Embedded.1#IPMILan.1]
AlertEnable=Disabled
CommunityName=public
Enable=Enabled
EncryptionKey=0000000000000000000000000000000000000000
PrivLimit=4

https://wiki.nikhef.nl/grid/Serial_Consoles Make sure the window is 80x25.

$ ipmitool -v -I lanplus -H 192.168.1.213 -U root -f ~/password sol activate

Clear all jobs:

jobqueue delete -i JID_CLEARALL_FORCE

This does not work in all cases: jobqueue delete --all

http://thornelabs.net/2014/04/16/dell-idrac-racadm-commands-and-scripts.html

Disable auth type none

https://www.thomas-krenn.com/en/wiki/Deactivate_IPMI_NONE_Authentication_Type

http://www.gooksu.com/2015/04/27/racadm-quick-dirty-cheatsheet/

Service Tags

  • cmc FBRZDZ1 (firmware 4.3.1)
  • slot 2 GV3VFZ1
  • 3 GV4TFZ1
  • 4 GV3WFZ1
  • 5 GV3TFZ1

Various tidbits

Tin's Journey iDRAC 7 CheatSheet

https://confluence.liskl.com/display/LDC/iDRAC+7+CheatSheet+with+racadm

https://github.com/hurulu/idrac-configure-script/blob/master/idrac_configure.sh

https://wikitech.wikimedia.org/wiki/Platform-specific_documentation/Dell_PowerEdge_RN10

http://comments.gmane.org/gmane.linux.hardware.dell.poweredge/37580

iDRAC Pass-through

http://en.community.dell.com/techcenter/systems-management/w/wiki/5097.os-to-idrac-pass-through-using-idrac7

https://github.com/hurulu/idrac-configure-script/blob/master/idrac_configure.sh

accessibility java viewer

map dvd with an iso

bios

racadam order

start.html and other pages hardwired with absolute redirects

getting caught with reboot, order of mods (need disks)

Map CD

lack of errors on boot

VNC requires enterprise license

setup serial on linux

ext4

swap didn't work? (see screenshot) create partition after?

virtual media

Clone this wiki locally