Fortunato Cuizon | 12 Jun 2013 05:09
Picon
Gravatar

Help with win32 port of vblade

I'm trying to port vblade to win32 using the winpcap library as a personal project, done it by just recoding something on linux.c...and compiled without problems on the latest orwell dev c++, however when the server is run, it can be seen on most aoe initiators, the problem is that when mounting the said "blade", it would not automount as an extra drive on windows while the original vblade server would have and no problems...this is just the problem i'm getting and if it would work, it's likely to work on mounting/booting an img file...any thoughts?

vblade-19, winpcap 4.12, orwell dev c++ (latest)

-changed getpkt, putpkt with wpcap related function
-changed putsec, getsec with ReadFile, WriteFile C functions

ported it okay, but with mounting problems, img booting (winxp) just okay on first part, booting to protected mode fails...(just there with the 'knight rider' status bar, nothing happening)

Regards

------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:

Build for Windows Store.

http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Tim Dossett | 24 May 2013 17:11
Picon

Re: Read only image

I've never gotten the WinAoE driver to work with Windows 7, but others claim to have; perhaps someone on the list can help.

On Fri, May 24, 2013 at 7:38 AM, Angelica Delgado <angelicadel230-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:

We tested the patch but the image gets stuck on aoe driver during boot.  It is Windows 7 64bit.

On May 20, 2013 9:59 AM, "Tim Dossett" <timothy.dossett-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
I don't know if AoE supports Windows 7 (last I checked WinAoE driver didn't), but it is possible to run several Windows XP PCs from 1 base image following this approach: http://etherboot.org/wiki/appnotes/cow


On Mon, May 13, 2013 at 8:51 PM, Angelica Delgado <angelicadel230-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:

We want to run vblade in read only mode for a windows 7 image.  Do you all know if it is possible? We want this virtual drive to be shared by multiple computers?

Thanks.
Angelica


------------------------------------------------------------------------------
AlienVault Unified Security Management (USM) platform delivers complete
security visibility with the essential security capabilities. Easily and
efficiently configure, manage, and operate all of your security controls
from a single console and one unified framework. Download a free trial.
http://p.sf.net/sfu/alienvault_d2d
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss



------------------------------------------------------------------------------
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Fortunato Cuizon | 19 May 2013 13:28
Picon
Gravatar

why ported vblade to windows 5x slower?

i've tried to experiment porting vblade-20 to win32 native using multithreading, winpcap (sending/receiving packets) and createfile/setfilepointer/readfile (replacing direct ata calls), i've just barely made it work, but i'm a bit disappointed about the speed, there has been a vblade ported to cygwin that i am also using and that is much more faster then my ported vblade...i'm wondering why...

does direct ata calls are signicantly faster than emulating them through readfile?

does linux native putpkt faster than sending through winpcap? (been using winpcap que function to que sending packets)

i've been porting this project using orwell dev c++ and using multithreading so that instead of having 1 process/vblade server, i have the option of sticking 10 threads/vblade server...

also i haven't begin to optimize (yet)...

------------------------------------------------------------------------------
AlienVault Unified Security Management (USM) platform delivers complete
security visibility with the essential security capabilities. Easily and
efficiently configure, manage, and operate all of your security controls
from a single console and one unified framework. Download a free trial.
http://p.sf.net/sfu/alienvault_d2d
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Angelica Delgado | 14 May 2013 03:51
Picon

Read only image

We want to run vblade in read only mode for a windows 7 image.  Do you all know if it is possible? We want this virtual drive to be shared by multiple computers?

Thanks.
Angelica

------------------------------------------------------------------------------
AlienVault Unified Security Management (USM) platform delivers complete
security visibility with the essential security capabilities. Easily and
efficiently configure, manage, and operate all of your security controls
from a single console and one unified framework. Download a free trial.
http://p.sf.net/sfu/alienvault_d2d
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Angelica Delgado | 1 May 2013 01:15
Picon

server specs needed for aoe

We want to setup a test lab with 100 diskless computers using aoe vblade.  However, we cannot find the server specs needed for AoE in terms of which resources are used the most by AoE protocol such as  how much RAM, number of CPUs , and network connections. 
 
Thanks.
Angela
------------------------------------------------------------------------------
Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET
Get 100% visibility into your production application - at no cost.
Code-level diagnostics for performance bottlenecks with <2% overhead
Download for free and get started troubleshooting in minutes.
http://p.sf.net/sfu/appdyn_d2d_ap1
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Lars Täuber | 8 Apr 2013 17:52
X-Face
Picon
Favicon

ggaoed & linux kernel client with minor/slot >= 16

Hi there,

I experience a problem with ggaoed latest version and a linux kernel client.
The kernel is a version 3.2.0 from 12.04 ubuntu server amd64.
I can't connect a slot with number 16.

Here is the part of my ggaoed.conf:

[Name]
path    = /dev/DRBD/KVMname
shelf   = 2
slot    = 16
accept  = client03,client04

An aoe-discover followed by an aoe-stat on the client side only shows disks with minor (slot) up to 15.

Via wireshark I see the »Config Information Responses« for major 0x0002 and minor 0x10.

Has someone a hint for me?

Thanks
Lars

------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire 
the most talented Cisco Certified professionals. Visit the 
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
PongráczI | 6 Apr 2013 12:06

Re: Error checking against data corruption viaethernet


 

----------------eredeti üzenet-----------------
Feladó: "Alexandre" <alxgomz-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
Címzett: "PongráczI" <pongraczi-DMSA/VFjocCJhwefxg0Ghb9Ecf289nFAVpNB7YpNyf8@public.gmane.org>
CC: "aoetools-discuss lists.sourceforge.net" <aoetools-discuss-5NWGOfrQmneHXe+LvDLADg@public.gmane.orgrceforge.net>
Dátum: Sat, 6 Apr 2013 10:57:22 +0100
----------------------------------------------------------


Oh are you talking about iSCSI Digest?
 
If so I recommend you read this (only the the chapter should be enough to shced a ligth):
http://www.jdsu.com/ProductLiterature/Understanding-iSCSI-Digests-white-paper-30162803.pdf

 
To make the long story short, iSCSI digest is meant to protect against errors during protocol transitions on the hosts, which are highly used in iscsi ([data]/iSCSI-> TCP -> IP -> Ethernet) while aoe only uses ethernet as a carrier so is far less prone to this kind of error.

 
Moreover, the overhead introduced by digest seems to have lead people to disable it in most cases (most initiators disable it by default, and the document states that it is known to be a common practice in the iscsi world). Instead, integrity is ensured by Etherne qnd IP checksums (whle AoE only needs to check the Ethernet CRC).

 
If you're talking about another mechanism please let us know.
 


 

Alexandre, thank you for your valuable answer! Good to know, iscsi in practice has a good protection, which commonly disabled, great :)

So, as I checked the Layer2, it has error checking as you wrote. So, as I understand now, data corruption cannot happen on layer2, because this basic CRC protection handle layer 1 issues which can happen in the physical layer.

István

------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire 
the most talented Cisco Certified professionals. Visit the 
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
PongráczI | 6 Apr 2013 12:00

Re: Error checking against data corruption viaethernet


 

----------------eredeti üzenet-----------------
Feladó: "Alexandre" <alxgomz-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
Címzett: "PongráczI" <pongraczi-DMSA/VFjocCJhwefxg0Ghb9Ecf289nFAVpNB7YpNyf8@public.gmane.org>
CC: "aoetools-discuss lists.sourceforge.net" <aoetools-discuss-5NWGOfrQmneHXe+LvDLADg@public.gmane.orgrceforge.net>
Dátum: Sat, 6 Apr 2013 10:24:10 +0100
----------------------------------------------------------


I am not sure to understand against which type of error you want a protection/detection of.
 
Are you talking about corruption of data during the the transport over the wire?
 
Can you find the name of the feature implemented in iscsi you'd like to check for in aoe?

 
regards, Alex
 

 

Hi,
 

Thank you for your feedback! I try to explain my question in a better way :)

So, your first question is exactly my question: Are you talking about corruption of data during the the transport over the wire? Yes.

On the client side, I want to write to the disk a data, for example a binary data: 01111000001111100001111    I want to be sure, on the server side it will be written to the disk the same data: 01111000001111100001111

At this moment, I do not know, if an electrical noise or whatever will alter the data sent trough the wire, how will layer 2 and AoE handle that situation?

For example I wrote 'piano' on the client, but 'violin' will be written to the disk on the server, due to the corruption during the transport over the wire happens. Is that possible to get this kind of corruption, or layer2+AoE can catch this situation and can fix this kind of issues?

I use ZFS filesystem, it uses end-to-end data protection by using extra checksum to every block written to the disk. This can provide very good data protection, but would be nice to know, using AoE will not cause corruption in a SAN environment. Others, who use iscsi, always tell me, iscsi has checksum to detect transfer issues, while AoE has no this kind of protection, so, to get data corruption can happen and will be not detected. In fact, I never used iscsi, due to that comparing to AoE it is much more complicated and I saw several people had issues to get it running on their environment. AoE just works.

Thank you!

István

 


 

For example, 

------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire 
the most talented Cisco Certified professionals. Visit the 
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
PongráczI | 27 Mar 2013 13:39

Error checking against data corruption via ethernet

Dear All,

I use AoE with ZFS in various configuration.

I really like AoE as it is very simple to deploy and working well with ZFS (ZoL).

The only thing, what I cannot answer (after checking the list archive without too much success), is there any solution, how to detect and resend corrupted data over the network?

For example, even if I use zfs on the initiator machine to protect data, it could be corrupted when transferred trough the ethernet and saved the corrupted data. When I will read back, I can detect the corrupted data, but not able to fix it (as zfs do normally when there are enough valid replication of the data).

In contrast, iscsi has this feature and lot of people use iscsi because it provides protection against such an error.

So, my question is are there any solution how to detect/fix these kind of errors?

Sorry, if this question already answered somewhere, in this case please let me know the link :)

Thank you!

István

------------------------------------------------------------------------------
Own the Future-Intel&reg; Level Up Game Demo Contest 2013
Rise to greatness in Intel's independent game demo contest.
Compete for recognition, cash, and the chance to get your game 
on Steam. $5K grand prize plus 10 genre and skill prizes. 
Submit your demo by 6/6/13. http://p.sf.net/sfu/intel_levelupd2d
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Alexandre | 6 Mar 2013 09:14
Picon
Gravatar

Re: Write-through cache

I don't know much about blade, but have you tried other aoe targets? For instance I know ggaoed have an option to use directIO, thus disabling any caching (and decreasing performance I guess, although I never measured this precisely). This option typically ensure data constancy, which seems to be  what you're trying to achieve.

On 6 Mar 2013 02:22, "PV" <pv2pv-EE1Pc4pW+aiHXe+LvDLADg@public.gmane.org> wrote:

Hello all,

I`ve tested this software and see, that I can`t turn off write cache. "Write cache off" can be a great feature for use with DRBD or so on.

Recently I`ve tested AOE with DRBD. Everything was working fine, but when I turn off primary server and then start AOE at secondary while writing data - there was data corruption.

iSCSI target has "write cache off" options and data was written correctly.

But as for me, AOE is faster, simplier and Windows client don`t hang while switching vblade from one server to another.

May be somebody can patch sources or tell me another way to turn off write cache?

Looking at the source of vblade-20, I see that this function perform write:

 

linux.c

....

int
putsec(int fd, uchar *place, vlong lba, int nsec)
{
        return pwrite(fd, place, nsec * 512, lba * 512);
}

....

So need to sync write queue before return?

May be using function

blk_queue_flush(q, REQ_FLUSH | REQ_FUA)

?

If it will be usefull, I can give additional information about versions, testing methods and so on.

 

PV.

 

 


 


------------------------------------------------------------------------------
Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester
Wave(TM): Endpoint Security, Q1 2013 and "remains a good choice" in the
endpoint security space. For insight on selecting the right partner to
tackle endpoint security challenges, access the full report.
http://p.sf.net/sfu/symantec-dev2dev
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

------------------------------------------------------------------------------
Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester  
Wave(TM): Endpoint Security, Q1 2013 and "remains a good choice" in the  
endpoint security space. For insight on selecting the right partner to 
tackle endpoint security challenges, access the full report. 
http://p.sf.net/sfu/symantec-dev2dev
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
PV | 6 Mar 2013 02:20
Picon
Favicon

Write-through cache

Hello all,

I`ve tested this software and see, that I can`t turn off write cache. "Write cache off" can be a great feature for use with DRBD or so on.

Recently I`ve tested AOE with DRBD. Everything was working fine, but when I turn off primary server and then start AOE at secondary while writing data - there was data corruption.

iSCSI target has "write cache off" options and data was written correctly.

But as for me, AOE is faster, simplier and Windows client don`t hang while switching vblade from one server to another.

May be somebody can patch sources or tell me another way to turn off write cache?

Looking at the source of vblade-20, I see that this function perform write:

 

linux.c

....

int
putsec(int fd, uchar *place, vlong lba, int nsec)
{
        return pwrite(fd, place, nsec * 512, lba * 512);
}

....

So need to sync write queue before return?

May be using function

blk_queue_flush(q, REQ_FLUSH | REQ_FUA)

?

If it will be usefull, I can give additional information about versions, testing methods and so on.

 

PV.

 

 


 

------------------------------------------------------------------------------
Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester  
Wave(TM): Endpoint Security, Q1 2013 and "remains a good choice" in the  
endpoint security space. For insight on selecting the right partner to 
tackle endpoint security challenges, access the full report. 
http://p.sf.net/sfu/symantec-dev2dev
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

Gmane