Mike Christie | 2 Jan 2011 05:45
Picon
Favicon

Re: udev related issue with latest upstream bits

On 12/30/2010 02:16 AM, Or Gerlitz wrote:
> Mike Christie wrote:
>> It looks like sg_map cheats and does not look at sysfs for this.
>> Will do one or the other.
>> It looks like some sg_map26 commands are broken with your kernel config
>> too now (sg_map26 uses sysfs where sg_map does not).
>
> yes, sg_map26 is very much broken indeed on my kernel... I wonder if this
> sysfs config is something we should worry about, specifically as RHEL6 isn't
> setting the _deprecated configs, are there other distros who does that?
>

I do not know. We do not do it in Fedora either.

--

-- 
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi@...
To unsubscribe from this group, send email to open-iscsi+unsubscribe@...
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.

Mike Christie | 2 Jan 2011 06:06
Picon
Favicon

Re: NFS hard semantics wanted: how to?

On 12/30/2010 10:09 PM, torn5 wrote:
> On 12/22/2010 07:09 PM, Mike Christie wrote:
>> On 12/22/2010 05:57 AM, torn5 wrote:
>>> Hello open-iscsi people
>>> I am approaching iscsi, and I am currently doing some "reliability"
>>> tests.
>>>
>>> In particular I would like to be able to reboot the target machine
>>> without the initiators to lose data.
>>> Like NFS hard mounts.
>>>
>>> [CUT]
>>>
>>> These are the errors I see:
>>> [31291.360009] EXT4-fs (sdd1): error count: 10
>>> [31291.360013] EXT4-fs (sdd1): initial error at 1292972264:
>>> ext4_remount:3755
>>> [31291.360015] EXT4-fs (sdd1): last error at 1292976117:
>>> ext4_put_super:719
>>> They look harmful...
>>>
>> Could you send the rest of your /var/log/messages? It should have some
>> scsi error code info and block layer error info.
>>
>> Could you also turn on iscsi eh debugging
>>
>
> Hello Mike
> sorry for the delay in the reply, I was doing some zillions of tests...
>
(Continue reading)

Mike Christie | 2 Jan 2011 06:10
Picon
Favicon

Re: NFS hard semantics wanted: how to?

On 01/01/2011 11:06 PM, Mike Christie wrote:
>
> What kernel version are you using? We have exactly that :) If you set it
> to -1 then you get your infinite timeout.
>

Oh yeah, this was added in 2.6.33.

--

-- 
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi@...
To unsubscribe from this group, send email to open-iscsi+unsubscribe@...
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.

Or Gerlitz | 2 Jan 2011 07:44

Re: udev related issue with latest upstream bits

Mike Christie wrote:
> I do not know. We do not do it in Fedora either.

okay, so I guess we'll leave it for that time being...

Or.

--

-- 
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi@...
To unsubscribe from this group, send email to open-iscsi+unsubscribe@...
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.

Rudy Gevaert | 2 Jan 2011 11:01
Picon

Re: qlogic hba: Could not offload sendtargets

thanks for the pointer, I'll try that next week.

--
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To unsubscribe from this group, send email to open-iscsi+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.
Rudy Gevaert | 2 Jan 2011 11:02
Picon

Re: qlogic hba: Could not offload sendtargets

Hi Pasi.  In fact I didn't.  I didn't know I needed some other tool.  I will have to look into that.  Thanks

--
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To unsubscribe from this group, send email to open-iscsi+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.
Fubo Chen | 1 Jan 2011 18:53
Picon

Re: MD-RAID1 and iSCSI with multipathd: some experience

On Oct 14 2010, 1:45 pm, "Ulrich Windl" <Ulrich.Wi...@...
regensburg.de> wrote:
> I was investigating the status of building a RAID1 over iSCSI-connected devices managed by multipathd
(SLES10 SP3 Release Notes said it won't work). Here are some of my findings:
>
> 1) The multipath-devices cannot be opened exclusively my mdadm:
> # mdadm --verbose --create /dev/md0 --raid-devices=2 --level=raid1 --bitmap=internal
/dev/disk/by-id/scsi-3600508b4001085dd0001100002260000 /dev/disk/by-id/scsi-3600508b4001085dd0001100002290000
> mdadm: Cannot open /dev/disk/by-id/scsi-3600508b4001085dd0001100002260000: Device or resource busy
> mdadm: Cannot open /dev/disk/by-id/scsi-3600508b4001085dd0001100002290000: Device or resource busy
> mdadm: create aborted
>
> open("/dev/disk/by-id/scsi-3600508b4001085dd0001100002260000", O_RDONLY|O_EXCL) = -1 EBUSY
(Device or resource busy)
>
> 2) The device-mapper files seem to be no SCSI Devices:
> # mdadm --verbose --create /dev/md0 --raid-devices=2 --level=raid1 --bitmap=internal /dev/dm-18 /dev/dm-19
> mdadm: /dev/dm-18 is too small: 0K
> mdadm: create aborted
> rkdvmso1:~ # sdparm -a /dev/dm-18
> unable to access /dev/dm-18, ATA disk?
>
> 3) The iSCSI devices are SCSI-devices, but are busy:
> # sdparm -a /dev/sdax
>     /dev/sdax: HP        HSV200            5000
> Read write error recovery mode page:
>   AWRE        1  [cha: n, def:  1]
>   ARRE        1  [cha: n, def:  1]
>   TB          1  [cha: n, def:  1]
>   RC          0  [cha: n, def:  0]
> [...]
> # mdadm --verbose --create /dev/md0 --raid-devices=2 --level=raid1 --bitmap=internal /dev/sdax /dev/sdbo
> mdadm: Cannot open /dev/sdax: Device or resource busy
> mdadm: Cannot open /dev/sdbo: Device or resource busy
> mdadm: create aborted
>
> I'm not a specialist on mdadm, so please if I did something wrong, please tell me.

Hi,

I have been looking at related but not identical question: to
replicate local disk to another server via iSCSI and md mirroring
(RAID1, no multipath). While making that setup I noticed that open-
iscsi times out SCSI commands if the network falls away long enough.
Why does open-iscsi initiator make SCSI commands fail instead of
reporting disk removal ?

$ sg_inq /dev/disk/by-path/ip-192.168.3.114\:3260-iscsi-...:tgt-lun-0
| grep RMB
  PQual=0  Device_type=0  RMB=0  version=0x05  [SPC-3]

Fubo.

--

-- 
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi@...
To unsubscribe from this group, send email to open-iscsi+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.

Fubo Chen | 1 Jan 2011 19:50
Picon

Re: MD-RAID1 and iSCSI with multipathd: some experience

On October 14, Ulrich Windl wrote:
> I was investigating the status of building a RAID1 over iSCSI-
> connected devices managed by multipathd (SLES10 SP3 Release Notes said
> it won't work). Here are some of my findings:
>
> 1) The multipath-devices cannot be opened exclusively my mdadm:
> # mdadm --verbose --create /dev/md0 --raid-devices=2 --level=raid1 --
> bitmap=internal /dev/disk/by-id/
> scsi-3600508b4001085dd0001100002260000 /dev/disk/by-id/
> scsi-3600508b4001085dd0001100002290000
> mdadm: Cannot open /dev/disk/by-id/
> scsi-3600508b4001085dd0001100002260000: Device or resource busy
> mdadm: Cannot open /dev/disk/by-id/
> scsi-3600508b4001085dd0001100002290000: Device or resource busy
> mdadm: create aborted
>
> open("/dev/disk/by-id/scsi-3600508b4001085dd0001100002260000",
> O_RDONLY|O_EXCL) = -1 EBUSY (Device or resource busy)
>
> 2) The device-mapper files seem to be no SCSI Devices:
> # mdadm --verbose --create /dev/md0 --raid-devices=2 --level=raid1 --
> bitmap=internal /dev/dm-18 /dev/dm-19
> mdadm: /dev/dm-18 is too small: 0K
> mdadm: create aborted
> rkdvmso1:~ # sdparm -a /dev/dm-18
> unable to access /dev/dm-18, ATA disk?
>
> 3) The iSCSI devices are SCSI-devices, but are busy:
> # sdparm -a /dev/sdax
>     /dev/sdax: HP        HSV200            5000
> Read write error recovery mode page:
>   AWRE        1  [cha: n, def:  1]
>   ARRE        1  [cha: n, def:  1]
>   TB          1  [cha: n, def:  1]
>   RC          0  [cha: n, def:  0]
> [...]
> # mdadm --verbose --create /dev/md0 --raid-devices=2 --level=raid1 --
> bitmap=internal /dev/sdax /dev/sdbo
> mdadm: Cannot open /dev/sdax: Device or resource busy
> mdadm: Cannot open /dev/sdbo: Device or resource busy
> mdadm: create aborted
>
> I'm not a specialist on mdadm, so please if I did something wrong,
> please tell me.

Hi,

I have been looking at related but not identical problem. I'm trying
to use md to replicate local disk to remote server by iSCSI and
mirroring (RAID1). But I noticed that iSCSI commands fail if network
timeout occurs longer than the iSCSI command timeout. I noticed that
the block device created by open-iscsi is marked as non-removable
(RMB=0). Why does open-iscsi behave this way and why does it not
report disk removal event if network connection fails ?

# mdadm --query --detail /dev/md4 | tail -n 3
    Number   Major   Minor   RaidDevice State
       0       8       32        0      active sync   /dev/sdc
       1       8       64        1      active sync   /dev/sde

# sg_inq /dev/disk/by-path/ip-192.168.3.114\:3260-iscsi-iqn\:tgt-lun-0
| grep RMB
  PQual=0  Device_type=0  RMB=0  version=0x05  [SPC-3]

Fubo.

--

-- 
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi@...
To unsubscribe from this group, send email to open-iscsi+unsubscribe@...
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.

Mike Christie | 3 Jan 2011 21:39
Picon
Favicon

Re: DCB support for iSCSI

On 12/22/2010 11:22 PM, Shyam_Iyer@... wrote:
>> VLAN creation.
>>  From what I've seen iSCSI support in DCB would work similar
>> to FCoE, ie the iSCSI traffic will be sent via a separate
>> VLAN. Which we would need to create, eventually.
>> So basically we would need something similar to 'fipvlan'
>> or integrate this functionality into open-iscsi.
>
> Well there are more methods actually. Separating them into separate VLAN's would tag them to the priority
of the VLAN(8 in all) however sometimes the tag is based on the application type port number.
>
> So, in the iSCSI case the well known port number 3260 becomes the priority decider.
>

I actually broke the code to support ports other than 3260 in a rhel 
test release, and so I know people use other ports in real life setups 
:) I would bet the vast majority of times it is 3260, but it is not 
always so I do not think you can count on it if that is what you are saying.

> Usecase - Tag all iSCSI traffic to a specific port type in a virtualized environment. Its very cumbersome
to manage vlans in the virtualized environments.
>
> Also ETS determines that within the same priority group the bandwidth could be split further. Now, this
could be per connection.  My hunch is that we need more flexible ways of splitting the bandwidth within a
priority group per connection via the lldpad.
>

What is ETS?

--

-- 
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi@...
To unsubscribe from this group, send email to open-iscsi+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.

Mike Christie | 3 Jan 2011 21:48
Picon
Favicon

Re: DCB support for iSCSI

On 12/23/2010 01:23 PM, Rustad, Mark D wrote:
> Shyam,
>
>> -----Original Message-----
>> From: Shyam_Iyer@... [mailto:Shyam_Iyer@...]
>> Sent: Wednesday, December 22, 2010 9:23 PM
>> To: open-iscsi@...
>> Cc: Rustad, Mark D
>> Subject: RE: DCB support for iSCSI
>>
>>> -----Original Message-----
>>> From: open-iscsi@... [mailto:open-
>> iscsi@...]
>>> On Behalf Of Hannes Reinecke
>>> Sent: Monday, December 20, 2010 6:47 AM
>>> To: open-iscsi@...
>>> Cc: Rustad, Mark D
>>> Subject: Re: DCB support for iSCSI
>>>
>>> On 12/17/2010 06:55 PM, Rustad, Mark D wrote:
>>>> Hi all,
>>>>
>>>> I am looking into adding support for DCB into iSCSI. I think
>>>> it is best to do this in a way that will not require a strong
>>>> dependency on DCB for iSCSI. That is, installing open-iscsi
>>>> should not then require open-lldp to also be installed. I see
>>>> at least two ways to do this.
>>>>
>>>> The first is to have open-lldp supply a library that iscsid
>>>> can link with at run time (through dlopen/dlsym). In that way,
>>>> if the library is not there, iscsid can go on as usual. It
>>>> also allows lldpad more freedom to change over time.
>>>>
>>>> The second way is to put a little more code directly in
>>>> iscsid and have it interrogate lldpad for the proper priority
>>>> to set. If the lldpad socket isn't there, iscsid can go on as
>>>> usual. I am thinking that open-lldp can supply the source files
>>>> that would be placed directly into open-iscsi and updated as
>>>> needed. These source files might also be used by other network
>>>> applications that want to participate fully in a DCB environment.
>>>>
>>>> I had been leaning toward the first way until I started thinking
>>>> about iscsistart and initrds. Then it seemed that the run-time
>>>> linkage would create more trouble than it would be worth.
>>>> It started to seem like over-engineering.
>>>>
>>> I would prefer the second method.
>>> DCB configuration itself is quite involved and requires to
>>> negotiate the transfer parameter before the connection is setup.
>>> And as DCB is in fact quite a different beast from iSCSI we
>>> should keep it as a separate daemon.
>>> Which would also be in-line with the current fcoeadm setup.
>>
>> I  would also prefer a dcb client like that allows configuring for
>> iSCSI traffic.  I do need an open-lldpad as a library though but that
>> is to integrate the library with libvirt to keep the architecture clean
>> and not have libvirt call various exec commands to configure dcb for
>> VMs.
>>
>>>> In either case, I was thinking about adding code right before
>>>> the connect() call in iscsi_io_tcp_connect to set the socket
>>>> options based on information from lldpad. Is anything more
>>>> than that needed (besides doing something similar in iscsistart)?
>>>>
>>> VLAN creation.
>>>  From what I've seen iSCSI support in DCB would work similar
>>> to FCoE, ie the iSCSI traffic will be sent via a separate
>>> VLAN. Which we would need to create, eventually.
>>> So basically we would need something similar to 'fipvlan'
>>> or integrate this functionality into open-iscsi.
>>
>> Well there are more methods actually. Separating them into separate
>> VLAN's would tag them to the priority of the VLAN(8 in all) however
>> sometimes the tag is based on the application type port number.
>
> Exactly. That is what I am trying to support by querying lldpad as to what the priority should be for the
application, iscsi in this case.
>
>> So, in the iSCSI case the well known port number 3260 becomes the
>> priority decider.
>
> Except when the system is set up to use a non-standard port. If one could count on the standard port always
being used, this could be handled in the kernel and be directly controlled by lldpad. At least if all of the
iscsi traffic on an interface should be at the same priority.
>
>> Usecase - Tag all iSCSI traffic to a specific port type in a
>> virtualized environment. Its very cumbersome to manage vlans in the
>> virtualized environments.
>>
>> Also ETS determines that within the same priority group the bandwidth
>> could be split further. Now, this could be per connection.  My hunch is
>> that we need more flexible ways of splitting the bandwidth within a
>> priority group per connection via the lldpad.
>
> I had been wondering if target address should also be considered in setting the priority. I had mainly been
considering interface and application just because that seems to be what lldpad knows and cares about. Of
course, lldpad returns a mask of allowed priorities for an application, so iscsid could choose among
those priorities. So it would seem that additional iscsi configuration would be required to add target
address into the priority selection scheme. Is this a desirable addition to open-iscsi?
>

So you are thinking that you would have one interface on the initiator 
that is connected to 2 targets portals, and the connection to each 
target portal would need a different priority? That sounds like 
something that would happen.

So would then the iscsi query lldpad with the interface and application 
info. Then lldpad sends the priority mask. iscsi then looks up user 
specified info (a target address,port,interface to priority map) and 
then set the priority?

--

-- 
You received this message because you are subscribed to the Google Groups "open-iscsi" group.
To post to this group, send email to open-iscsi@...
To unsubscribe from this group, send email to open-iscsi+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.


Gmane