From aihtdikh at gmail.com Thu Nov 1 22:05:33 2007 From: aihtdikh at gmail.com (aihtdikh) Date: Thu Nov 1 22:07:11 2007 Subject: Index of errors? In-Reply-To: <20071101160007.A61BC15CD5E@cp.thetahost.com> References: <20071101160007.A61BC15CD5E@cp.thetahost.com> Message-ID: <472A85ED.9010103@gmail.com> I'll play too - another non-expert, I'm afraid. You won't need to build the nightly yourself, that's what the nightly builds are all about ;) Regarding the error messages... I've been converting our repository project by project, slowly over the last year or so. I did a bunch recently with the latest nightly (20071002) that went quite well - dare I say perfectly, even. It would be nice to know what the errors mean, but these days I just treat them as warnings. I always do a full directory comparison between a fresh checkout from VSS and a fresh working copy from svn, and browse around in the history until I'm satisfied that everthing looks ok. If that all checks out fine, then that's enough for me. I suspect that the only places that hold explanations for the messages are the source, and the brains of our apparently missing experts - who I hope are on holiday, lazing in the sun - they've earned it! My thanks to those who dealt with VSS so that we don't have to! Harun > Ok, I'll play. I hate to see that no one answered yet. Certainly not > the expert, but here goes. > > I would recommend getting the most recent nightly build. It will have > many bugs fixed. Unfortunately I think you have to build it yourself. > There is an SVN archive and you have to down load active perl and some > functions for it (I think). I managed to do it without too many tries, > so it couldn't be too hard. I'm not a perl user but a muddled through. > > Make absolutely sure you have run the analyze and repair on your VSS > database. > > None the less you are likely to wind up with some strange results. Some > of names and versions get real strange due to differences between unix > and windows file and path naming conventions. I wound up with quite a > few invalid path names. Honestly can't remember how I fixed all that. > I may have edited some of the names in the intermediate file. I seem to > remember reading on this list that most of those bugs have been fixed, > so maybe you won't have that problem. > > Now that I've typed this, maybe the experts will post the real answers. > Good luck though. > > Scott > > > > ________________________________ > > From: vss2svn-users-bounces@lists.pumacode.org > [mailto:vss2svn-users-bounces@lists.pumacode.org] On Behalf Of Bruce > Wilson > Sent: Wednesday, October 31, 2007 4:29 PM > To: vss2svn-users@lists.pumacode.org > Subject: Re: vss2svn-users Digest, Vol 19, Issue 7 > > > Wow, I didn't realize this question would bring such a hush on > the list. :-) > > Anybody there? > > > > > > Subject: > Index of errors? > Date: > Mon, 22 Oct 2007 12:23:50 -0500 > > I'm finally getting serious about migrating from VSS to > SVN. My new repository is up and live, now it's time for the messy > work. > > My first test (using 0.11 Alpha 1) produced an > alarming-looking list of errors. I know not to panic, but I'd like to > see what I can do to improve on the situation before I do my final. > > I looked around the Wiki for any index as to what each > error means, how serious it is, and what (if anything) can be done to > correct or compensate. I came up empty. This seems like a very useful > thing to have, and if I could obtain some of this information, I'd be > happy to turn this into one or more Wiki pages for future reference. > > I'd also read that trunk may be more "stable" than 0.11 > Alpha 1. Is there a good way to get a binary of trunk? (Again, seems > like this would be a good thing to update on the site.) > > Thanks for all your (volunteer) help. > > From jd_hardcastle at yahoo.com Wed Nov 7 04:53:28 2007 From: jd_hardcastle at yahoo.com (Jon Hardcastle) Date: Wed Nov 7 04:53:36 2007 Subject: differences between nighty~stable Message-ID: <981878.7803.qm@web51303.mail.re2.yahoo.com> Hello, I have run the same VSS DB on both vss2svn-nightly-20071002 and vss2svn-0.11.0-alpha1 they both 'complete' the export with minor differences in the time taken, and the number of revisions exported. BUT when i do a 'load' into subversion the vss2svn-0.11.0-alpha1 build 'loads' ok but the nightly bombs on 3317 of ~3357 with <<< Started new transaction, based on original revision 3318 * adding path : Cbwb706/Pencalc32/SigFigPatch/MFCSigFigPatch.cpp ...svnadmin: File not found: transaction '3317-1', path 'Cbwb706/Pencalc32/SigFigPatch/MFCSigFigPatch.cpp' Any ideas? ----------------------- N: Jon Hardcastle E: Jon@eHardcastle.com 'The writing is on the wall...' ----------------------- From andre.doherty at gmail.com Fri Nov 16 09:37:08 2007 From: andre.doherty at gmail.com (=?ISO-8859-1?Q?Andr=E9_Doherty?=) Date: Fri Nov 16 09:37:15 2007 Subject: Bug report in ssphy Message-ID: <2ce6733c0711160637x494b33b6q5e0ee25823efe61e@mail.gmail.com> Skipped content of type multipart/alternative-------------- next part -------------- A non-text attachment was scrubbed... Name: tinyxml.cpp.DIFF Type: application/octet-stream Size: 239 bytes Desc: not available Url : http://lists.pumacode.org/pipermail/vss2svn-users-lists.pumacode.org/attachments/20071116/376e54af/tinyxml.cpp.obj From toby at etjohnson.us Fri Nov 16 09:53:39 2007 From: toby at etjohnson.us (Toby Johnson) Date: Fri Nov 16 09:53:42 2007 Subject: Bug report in ssphy In-Reply-To: <2ce6733c0711160637x494b33b6q5e0ee25823efe61e@mail.gmail.com> References: <2ce6733c0711160637x494b33b6q5e0ee25823efe61e@mail.gmail.com> Message-ID: <473DAEF3.1090803@etjohnson.us> Andr? Doherty wrote: > hello, > > I would like to report a bug i found in ssphys that causes the whole > process to fail. > > In a somehow corrupted VSS database i am currently migrating to SVN, i > meet some entries where the FORM FEED (0x0c) character is present in > comments. > > Unfortunately this character is not a valid XML character, when > considered a white space (function isspace(0x0c) returns != 0), > therefore the parsing of the XML produced by ssphys (info) fails. > > I have patched the source code, so that this character would be > skipped if encountered. Please find the patch attached to this email. > > Thank you all for this nice piece of work, very useful and long live > svn ;) Thanks for the patch Andr?. However, tinyxml is a 3rd party tool and since I'm not as familiar with C++ I'm hesitant to simply patch that file in our source. Can anyone speak as to why the form feed character is not considered whitespace by isspace()? Maybe we should ask the tinyxml folks whether they would accept a patch to make their parser regard form feed as whitespace. Andr?, just for future reference, when submitting a patch to a project using SVN as version control, it's preferable to use "svn diff" to create patches since it makes it easier to apply. thanks, toby From andre.doherty at gmail.com Fri Nov 16 10:11:20 2007 From: andre.doherty at gmail.com (=?ISO-8859-1?Q?Andr=E9_Doherty?=) Date: Fri Nov 16 10:11:26 2007 Subject: Bug report in ssphy In-Reply-To: <473DAEF3.1090803@etjohnson.us> References: <2ce6733c0711160637x494b33b6q5e0ee25823efe61e@mail.gmail.com> <473DAEF3.1090803@etjohnson.us> Message-ID: <2ce6733c0711160711p7bd85a4fh36d87101673e6117@mail.gmail.com> Skipped content of type multipart/alternative-------------- next part -------------- A non-text attachment was scrubbed... Name: tinyxml.cpp.svndiff Type: application/octet-stream Size: 456 bytes Desc: not available Url : http://lists.pumacode.org/pipermail/vss2svn-users-lists.pumacode.org/attachments/20071116/d1208818/tinyxml.cpp.obj From jamesh at ali.com.au Wed Nov 21 18:51:45 2007 From: jamesh at ali.com.au (Hall, James) Date: Wed Nov 21 18:51:54 2007 Subject: VSS labels In-Reply-To: <468AF942.2090701@etjohnson.us> Message-ID: <6CB8A668476DF44987D826AA4CCCF5F408882F@AURB-EXCH-V1.ali.local> Hey Guys Using the vss2svn conversion process how much control do I have how vss labels are treated. James IMPORTANT CONFIDENTIALITY NOTICE: This E-mail (including any documents referred to in, or attached, to this E-mail) may contain information that is personal, confidential or the subject of copyright, privilege or other proprietary rights in favor of Aristocrat, its affiliates or third parties. This E-mail is intended only for the named addressee. Any privacy, confidence, legal professional privilege, copyright or other proprietary rights in favor of Aristocrat, its affiliates or third parties, is not lost if this E-mail was sent to you by mistake. If you received this E-mail by mistake you should: (i) not copy, disclose, distribute or otherwise use it, or its contents, without the consent of Aristocrat or the owner of the relevant rights; (ii) let us know of the mistake by reply E-mail or by telephone (AUS +61 2 9413 6300 or USA 1-877-274-9661); and (iii) delete it from your system and destroy all copies. Any personal information contained in this E-mail must be handled in accordance with applicable privacy laws. Electronic and internet communications can be interfered with or affected by viruses and other defects. As a result, such communications may not be successfully received or, if received, may cause interference with the integrity of receiving, processing or related systems (including hardware, software and data or information on, or using, that hardware or software). Aristocrat gives no assurances in relation to these matters. If you have any doubts about the veracity or integrity of any electronic communication we appear to have sent you, please call (AUS +61 2 9413 6300 or USA 1-877-274-9661) for clarification. From jd_hardcastle at yahoo.com Mon Nov 26 11:34:32 2007 From: jd_hardcastle at yahoo.com (Jon Hardcastle) Date: Mon Nov 26 11:35:28 2007 Subject: Labels and Nightlys! Message-ID: <167590.82686.qm@web51302.mail.re2.yahoo.com> Can anyone tell me what the status is with labels and migration? Also, is anyone having problems with the last couple of nightly and the import in SVN? Thanks. ----------------------- N: Jon Hardcastle E: Jon@eHardcastle.com 'The writing is on the wall...' ----------------------- From brucetwilson at gmail.com Mon Nov 26 12:10:33 2007 From: brucetwilson at gmail.com (Bruce Wilson) Date: Mon Nov 26 12:17:13 2007 Subject: A minor bug Message-ID: <474AFE09.5080801@toomuchblue.com> Found a minor but annoying bug in vss2svn.pl, which of course is reflected in the nightly build where I can't change it. If --md5 is not specified, an error is reported: Use of uninitialized value in concatenation (.) or string at vss2svn.pl line 1289. Looks like the easy fix is to add line 1974: $gCfg{md5} = 0 unless defined $gCfg{md5}; Right after existing line 1973: $gCfg{timing} = 0 unless defined $gCfg{timing}; I didn't figure a fix of this magnitude was worth a formal diff file... From brucetwilson at gmail.com Mon Nov 26 12:18:52 2007 From: brucetwilson at gmail.com (Bruce Wilson) Date: Mon Nov 26 12:19:04 2007 Subject: VSS labels In-Reply-To: <6CB8A668476DF44987D826AA4CCCF5F408882F@AURB-EXCH-V1.ali.local> References: <6CB8A668476DF44987D826AA4CCCF5F408882F@AURB-EXCH-V1.ali.local> Message-ID: <474AFFFC.1090901@toomuchblue.com> I am no expert, but from what I've read in the docs, it looks like you can choose the repository path where SVN "tags" are created for each label. I suppose if you wanted to discard some or all labels, you could use svndumpfilter to remove them before svnadmin load. What kind of control are you looking for? Hall, James wrote: > Hey Guys > > Using the vss2svn conversion process how much control do I have how vss > labels are treated. > > James > > > IMPORTANT CONFIDENTIALITY NOTICE: > > This E-mail (including any documents referred to in, or attached, to this E-mail) may contain information that is personal, confidential or the subject of copyright, privilege or other proprietary rights in favor of Aristocrat, its affiliates or third parties. This E-mail is intended only for the named addressee. Any privacy, confidence, legal professional privilege, copyright or other proprietary rights in favor of Aristocrat, its affiliates or third parties, is not lost if this E-mail was sent to you by mistake. > > If you received this E-mail by mistake you should: (i) not copy, disclose, distribute or otherwise use it, or its contents, without the consent of Aristocrat or the owner of the relevant rights; (ii) let us know of the mistake by reply E-mail or by telephone (AUS +61 2 9413 6300 or USA 1-877-274-9661); and (iii) delete it from your system and destroy all copies. > > Any personal information contained in this E-mail must be handled in accordance with applicable privacy laws. > > Electronic and internet communications can be interfered with or affected by viruses and other defects. As a result, such communications may not be successfully received or, if received, may cause interference with the integrity of receiving, processing or related systems (including hardware, software and data or information on, or using, that hardware or software). Aristocrat gives no assurances in relation to these matters. > > If you have any doubts about the veracity or integrity of any electronic communication we appear to have sent you, please call (AUS +61 2 9413 6300 or USA 1-877-274-9661) for clarification. > > _______________________________________________ > vss2svn-users mailing list > Project homepage: > http://www.pumacode.org/projects/vss2svn/ > Subscribe/Unsubscribe/Admin: > http://lists.pumacode.org/mailman/listinfo/vss2svn-users-lists.pumacode.org > Mailing list web interface (with searchable archives): > http://dir.gmane.org/gmane.comp.version-control.subversion.vss2svn.user > > From brucetwilson at gmail.com Mon Nov 26 12:30:26 2007 From: brucetwilson at gmail.com (Bruce Wilson) Date: Mon Nov 26 12:30:40 2007 Subject: Index of errors? In-Reply-To: <472A85ED.9010103@gmail.com> References: <20071101160007.A61BC15CD5E@cp.thetahost.com> <472A85ED.9010103@gmail.com> Message-ID: <474B02B2.7010106@toomuchblue.com> Thanks, I don't know why I thought the nightly would be anything other than a Win32 build. From other docs I've seen (e.g. http://www.pumacode.org/projects/vss2svn/wiki/AutomatedWorkflow), it does appear that some "errors" can indicate more than just warnings. Perhaps not even technical problems in the migration process, but /situations/ which the user may want to resolve differently before running a final. I've added a link from the FAQ page to a new ErrorMessages page, which I hope to fill in with whatever information I can discover, in the hopes others will fill in the blanks. Apparently, I have permission to add a link, but not to create the new empty page. Could someone with that authority create the stub page so I can add to it, or tell me how I can get a login to add the page myself? I'd like to help out if I can... aihtdikh wrote: > I'll play too - another non-expert, I'm afraid. > > You won't need to build the nightly yourself, that's what the nightly > builds are all about ;) > > Regarding the error messages... > I've been converting our repository project by project, slowly over > the last year or so. > I did a bunch recently with the latest nightly (20071002) that went > quite well - dare I say perfectly, even. > It would be nice to know what the errors mean, but these days I just > treat them as warnings. > I always do a full directory comparison between a fresh checkout from > VSS and a fresh working copy > from svn, and browse around in the history until I'm satisfied that > everthing looks ok. > If that all checks out fine, then that's enough for me. > I suspect that the only places that hold explanations for the messages > are the source, > and the brains of our apparently missing experts - who I hope are on > holiday, lazing in the sun - they've earned it! > My thanks to those who dealt with VSS so that we don't have to! > > Harun > >> Ok, I'll play. I hate to see that no one answered yet. Certainly not >> the expert, but here goes. >> >> I would recommend getting the most recent nightly build. It will have >> many bugs fixed. Unfortunately I think you have to build it yourself. >> There is an SVN archive and you have to down load active perl and some >> functions for it (I think). I managed to do it without too many tries, >> so it couldn't be too hard. I'm not a perl user but a muddled through. >> >> Make absolutely sure you have run the analyze and repair on your VSS >> database. >> >> None the less you are likely to wind up with some strange results. Some >> of names and versions get real strange due to differences between unix >> and windows file and path naming conventions. I wound up with quite a >> few invalid path names. Honestly can't remember how I fixed all that. >> I may have edited some of the names in the intermediate file. I seem to >> remember reading on this list that most of those bugs have been fixed, >> so maybe you won't have that problem. >> >> Now that I've typed this, maybe the experts will post the real answers. >> Good luck though. >> >> Scott >> >> >> >> ________________________________ >> >> From: vss2svn-users-bounces@lists.pumacode.org >> [mailto:vss2svn-users-bounces@lists.pumacode.org] On Behalf Of Bruce >> Wilson >> Sent: Wednesday, October 31, 2007 4:29 PM >> To: vss2svn-users@lists.pumacode.org >> Subject: Re: vss2svn-users Digest, Vol 19, Issue 7 >> >> >> Wow, I didn't realize this question would bring such a hush on >> the list. :-) >> >> Anybody there? >> >> >> >> >> >> Subject: Index of errors? >> Date: Mon, 22 Oct 2007 12:23:50 -0500 >> >> I'm finally getting serious about migrating from VSS to >> SVN. My new repository is up and live, now it's time for the messy >> work. >> My first test (using 0.11 Alpha 1) produced an >> alarming-looking list of errors. I know not to panic, but I'd like to >> see what I can do to improve on the situation before I do my final. >> >> I looked around the Wiki for any index as to what each >> error means, how serious it is, and what (if anything) can be done to >> correct or compensate. I came up empty. This seems like a very useful >> thing to have, and if I could obtain some of this information, I'd be >> happy to turn this into one or more Wiki pages for future reference. >> >> I'd also read that trunk may be more "stable" than 0.11 >> Alpha 1. Is there a good way to get a binary of trunk? (Again, seems >> like this would be a good thing to update on the site.) >> Thanks for all your (volunteer) help. >> > > _______________________________________________ > vss2svn-users mailing list > Project homepage: > http://www.pumacode.org/projects/vss2svn/ > Subscribe/Unsubscribe/Admin: > http://lists.pumacode.org/mailman/listinfo/vss2svn-users-lists.pumacode.org > > Mailing list web interface (with searchable archives): > http://dir.gmane.org/gmane.comp.version-control.subversion.vss2svn.user > From jd_hardcastle at yahoo.com Tue Nov 27 05:25:21 2007 From: jd_hardcastle at yahoo.com (Jon Hardcastle) Date: Tue Nov 27 05:25:28 2007 Subject: differences between nighty~stable Message-ID: <759870.50294.qm@web51303.mail.re2.yahoo.com> Hey guys. Some time has passed. I'm a little bit older, a little bit wiser maybe. ..and there is a new nightly build! But alas I still get the same problem. Can anyone help? The migration completes, but when I 'load' into SVN I get an error saying a file can't be found! Pllease help! --- Jon Hardcastle wrote: > Hello, > > I have run the same VSS DB on both > > vss2svn-nightly-20071002 > > and > > vss2svn-0.11.0-alpha1 > > they both 'complete' the export with minor > differences > in the time taken, and the number of revisions > exported. > > BUT when i do a 'load' into subversion the > vss2svn-0.11.0-alpha1 build 'loads' ok but the > nightly > bombs on 3317 of ~3357 with > > <<< Started new transaction, based on original > revision 3318 > * adding path : > Cbwb706/Pencalc32/SigFigPatch/MFCSigFigPatch.cpp > ...svnadmin: File not found: transaction '3317-1', > path > 'Cbwb706/Pencalc32/SigFigPatch/MFCSigFigPatch.cpp' > > Any ideas? > > ----------------------- > N: Jon Hardcastle > E: Jon@eHardcastle.com > 'The writing is on the wall...' > ----------------------- > ----------------------- N: Jon Hardcastle E: Jon@eHardcastle.com 'The writing is on the wall...' ----------------------- From toby at etjohnson.us Tue Nov 27 10:18:52 2007 From: toby at etjohnson.us (Toby Johnson) Date: Tue Nov 27 10:18:57 2007 Subject: Index of errors? In-Reply-To: <474B02B2.7010106@toomuchblue.com> References: <20071101160007.A61BC15CD5E@cp.thetahost.com> <472A85ED.9010103@gmail.com> <474B02B2.7010106@toomuchblue.com> Message-ID: <474C355C.40300@etjohnson.us> Bruce Wilson wrote: > Thanks, I don't know why I thought the nightly would be anything other > than a Win32 build. > > From other docs I've seen (e.g. > http://www.pumacode.org/projects/vss2svn/wiki/AutomatedWorkflow), it > does appear that some "errors" can indicate more than just warnings. > Perhaps not even technical problems in the migration process, but > /situations/ which the user may want to resolve differently before > running a final. > > I've added a link from the FAQ page to a new ErrorMessages page, which > I hope to fill in with whatever information I can discover, in the > hopes others will fill in the blanks. Apparently, I have permission > to add a link, but not to create the new empty page. Could someone > with that authority create the stub page so I can add to it, or tell > me how I can get a login to add the page myself? > > I'd like to help out if I can... Thanks Bruce, it wasn't my intent to prevent anonymous users from creating pages, it's just difficult to balance the Wiki spam with well-meaning contributors. :) You should be able to now, please try again. toby From toby at etjohnson.us Tue Nov 27 10:20:32 2007 From: toby at etjohnson.us (Toby Johnson) Date: Tue Nov 27 10:20:35 2007 Subject: A minor bug In-Reply-To: <474AFE09.5080801@toomuchblue.com> References: <474AFE09.5080801@toomuchblue.com> Message-ID: <474C35C0.1030904@etjohnson.us> Bruce Wilson wrote: > Found a minor but annoying bug in vss2svn.pl, which of course is > reflected in the nightly build where I can't change it. If --md5 is > not specified, an error is reported: > > Use of uninitialized value in concatenation (.) or string at > vss2svn.pl line 1289. > > Looks like the easy fix is to add line 1974: > $gCfg{md5} = 0 unless defined $gCfg{md5}; > > Right after existing line 1973: > $gCfg{timing} = 0 unless defined $gCfg{timing}; > > I didn't figure a fix of this magnitude was worth a formal diff file... Thanks, I've added the fix. toby From toby at etjohnson.us Tue Nov 27 10:57:05 2007 From: toby at etjohnson.us (Toby Johnson) Date: Tue Nov 27 10:57:08 2007 Subject: differences between nighty~stable In-Reply-To: <759870.50294.qm@web51303.mail.re2.yahoo.com> References: <759870.50294.qm@web51303.mail.re2.yahoo.com> Message-ID: <474C3E51.6040708@etjohnson.us> Jon Hardcastle wrote: > Hey guys. > > Some time has passed. > > I'm a little bit older, a little bit wiser maybe. > > ..and there is a new nightly build! > > But alas I still get the same problem. Can anyone > help? > > The migration completes, but when I 'load' into SVN I > get an error saying a file can't be found! > > Pllease help! > Jon, Unfortunately at this point the main developers (including myself) are no longer very active in this project. Having an open-source VSS to svn converter is a pretty nasty beast since there is no possible way we can make the script behave in a sane manner in all possible edge cases. Just when we think we have figured out all the ways that VSS can screw up your data, it surprises us with new and ingenious ways we hadn't thought of. :) Couple that with the fact that this project naturally has a rather steep learning curve, along with the fact that this type of project is something most people only need to really use once (after it does its job, we'll never need it again). Most of us have "scratched our itches" and don't really have much time to continue further. So for your question as to what the status is of the labels and nightlies, the answer is just pretty much "what works, works, and what doesn't, doesn't." There is no particular roadmap or list of things we know are still broken, in the past we have just tried to take care of the various issues that arose as we and others found them but again since every VSS use case is different (and every database is in different states of brokenness) it's just very difficult to do sometimes. All that being said, some general advice I can give is: * Go back even further with the nightlies, after the last alpha "release" build but before some of the later changes, and see if you have better luck with those. * Inspect your data cache files from your latest run to look for the particular file that svnadmin dump is having a problem with and see if you can figure out where it's tripping up. (If a particular "physical" file in your VSS database is corrupt, you can also try temporarily moving or renaming it). * If labels in general seem to be giving you troubles, bypass that entire feature in vss2svn.pl. * Use svndumpfilter to remove the trouble points. From your particular error message, it's possible that the dumpfile is trying to add a file before its parent was created, so you may also be able to massage the dumpfile or manually create the path after you get the error then split the dumpfile from the point where it failed and resume from there. (If you follow that route then be sure to correct the svn:date revprop on the revision you manually added so that it's in between the two revisions on either side). If you are able to figure out any place where the script is breaking down for your particular use case, we'll gladly accept patches to fix them. Good luck, toby From brucetwilson at gmail.com Wed Nov 28 17:19:15 2007 From: brucetwilson at gmail.com (Bruce Wilson) Date: Wed Nov 28 17:19:27 2007 Subject: A minor bug In-Reply-To: <474C35C0.1030904@etjohnson.us> References: <474AFE09.5080801@toomuchblue.com> <474C35C0.1030904@etjohnson.us> Message-ID: <474DE963.4050100@toomuchblue.com> Thanks, Toby. I've downloaded the new nightly to test out. I found another, perhaps a bit larger. Right around the SVNIMPORT task, I get this error: Undefined subroutine &Text::Glob::glob_to_regex_string at Dumpfile/AutoProps.pm line 30 Looking at the source I was able to determine leaving out --auto_props is a workaround. My Perl knowledge is limited, but it appears the Text::Glob library may not have been bundled into the package. Is there any information I can send you to help diagnose this? Want a copy of my config file? Toby Johnson wrote: > Bruce Wilson wrote: >> Found a minor but annoying bug in vss2svn.pl, which of course is >> reflected in the nightly build where I can't change it. If --md5 is >> not specified, an error is reported: >> >> Use of uninitialized value in concatenation (.) or string at >> vss2svn.pl line 1289. >> >> Looks like the easy fix is to add line 1974: >> $gCfg{md5} = 0 unless defined $gCfg{md5}; >> >> Right after existing line 1973: >> $gCfg{timing} = 0 unless defined $gCfg{timing}; >> >> I didn't figure a fix of this magnitude was worth a formal diff file... > > Thanks, I've added the fix. > > toby > From brucetwilson at gmail.com Wed Nov 28 18:28:15 2007 From: brucetwilson at gmail.com (Bruce Wilson) Date: Wed Nov 28 18:28:26 2007 Subject: Index of errors? In-Reply-To: <474C355C.40300@etjohnson.us> References: <20071101160007.A61BC15CD5E@cp.thetahost.com> <472A85ED.9010103@gmail.com> <474B02B2.7010106@toomuchblue.com> <474C355C.40300@etjohnson.us> Message-ID: <474DF98F.4070904@toomuchblue.com> Thanks, Toby. I've added the page and started in with something easy: the error messages I could find in vss2svn.pl. http://www.pumacode.org/projects/vss2svn/wiki/ErrorMessages I'm glad for any review or contributions to this page. I'm not entirely happy with the current grouping, but it's enough to get started. If the groupings become clear, and there's enough entries on each page, it may work better to break each group onto its own page. Time will tell. Toby Johnson wrote: > Thanks Bruce, it wasn't my intent to prevent anonymous users from > creating pages, it's just difficult to balance the Wiki spam with > well-meaning contributors. :) You should be able to now, please try > again. > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.pumacode.org/pipermail/vss2svn-users-lists.pumacode.org/attachments/20071128/6f123e37/attachment.html From toby at etjohnson.us Wed Nov 28 22:42:37 2007 From: toby at etjohnson.us (Toby Johnson) Date: Wed Nov 28 22:42:42 2007 Subject: Index of errors? In-Reply-To: <474DF98F.4070904@toomuchblue.com> References: <20071101160007.A61BC15CD5E@cp.thetahost.com> <472A85ED.9010103@gmail.com> <474B02B2.7010106@toomuchblue.com> <474C355C.40300@etjohnson.us> <474DF98F.4070904@toomuchblue.com> Message-ID: <474E352D.5050900@etjohnson.us> Bruce Wilson wrote: > Thanks, Toby. > > I've added the page and started in with something easy: the error > messages I could find in vss2svn.pl. > > http://www.pumacode.org/projects/vss2svn/wiki/ErrorMessages > > > > I'm glad for any review or contributions to this page. I'm not > entirely happy with the current grouping, but it's enough to get > started. If the groupings become clear, and there's enough entries on > each page, it may work better to break each group onto its own page. > Time will tell. It looks great, thanks! That will surely help out with many of the questions that arise on the list. If I ever get around to it then there are some which should probably be shown only when debug mode is on since the sheer number of issues that arise in a typical conversion seems to concern many. toby -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.pumacode.org/pipermail/vss2svn-users-lists.pumacode.org/attachments/20071128/6b8a9efa/attachment.html From dbb14 at columbia.edu Thu Nov 29 17:19:48 2007 From: dbb14 at columbia.edu (David Blaikie) Date: Thu Nov 29 17:19:54 2007 Subject: Fwd: Memory error In-Reply-To: <470D5167.8000200@gillius.org> References: <470D2101.20005@gillius.org> <85ADF0B17B14A64A973404FBC0162F7B06FAD05F@NYC-EXCLS2.dc1.doubleclick.corp> <470D437A.9040403@gillius.org> <470D5167.8000200@gillius.org> Message-ID: Hi again Jason, follow-up question re your suggestion to run VSS2SVN on Linux to improve speed. I ran this idea by a colleague and he felt that, since the core functionality is compiled C, that it shouldn't run much faster on a Linux machine. Do you have any idea why this would have been the case for you? Was it because your Linux machine was just faster, or because you were using a RAM disk? Just because of our own hardware setups, it would take a great deal more time and trouble for us to move our repository to a Linux machine and would be easier to do so on a Windows machine. I would like to get more information before going forward with the Linux idea. Can you or anyone else on the list offer any more thoughts on this subject? thanks David On Oct 10, 2007 5:25 PM, Jason Winnebeck wrote: > David, if you want to keep the topic on the list remember to continue to > include vss2svn users e-mail. > > 40GB sounds huge to me. I hear people speak of repositories that large, > and I > don't know how it gets that way. Probably because we only use it to do > source > code. I converted a repository some months ago that represented 5 years of > development of a team of 1-5 developers. The converted SVN repository (1.3 > , > not 1.4 style) is 200MB. I considered that large. I don't think I would > envy > having to deal with a 40GB job. > > I noticed that when I ran the script on Linux it ran many times faster > than on > Windows (hours to minutes). When I ran the vss2svn script on a Linux RAM > disk, > the process went from many minutes to a few minutes. The conversion > process > and the subsequent svnadmin load are extremely I/O intensive and make lots > of > small writes. I suggest you use whatever is the fastest storage media you > can. > In fact, if you have more than one HD on a server, I suggest hosting VSS > on > one and vss2svn output on the other and reversing that to minimize the > switching of reads and writes, which kills HDs. I noticed when I was doing > partition resizing with gparted to move file systems around it was going > to > take an entire DAY to move the partition on the drive to another location, > but > it took 15 minutes to move it from disk A to disk B then from B back to A > in a > different location. Sequential reads vs random reads make or break this. > > If you make the process fast enough, perhaps if you have to convert the > whole > thing it won't be so bad. Extra memory or disks help. > > Jason > > David Blaikie wrote: > > Jason, thanks a lot for your knowledgeshare. I will try a few different > > things and see what might work. Perhaps I'll try to run the script on > > the whole 40GB. Does 40GB sound like an inordinately massive project? > > I've seen messages on this list saying that 10GB is large. If we've > > been building this thing up over the last 5 years, am I facing a Holy > > Grail - type situation? > > > > thanks again > > > > David > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.pumacode.org/pipermail/vss2svn-users-lists.pumacode.org/attachments/20071129/2481992c/attachment.html From dbb14 at columbia.edu Thu Nov 29 17:36:55 2007 From: dbb14 at columbia.edu (David Blaikie) Date: Thu Nov 29 17:37:02 2007 Subject: Fwd: Memory error In-Reply-To: <474F3DAB.6030603@gillius.org> References: <470D2101.20005@gillius.org> <85ADF0B17B14A64A973404FBC0162F7B06FAD05F@NYC-EXCLS2.dc1.doubleclick.corp> <470D437A.9040403@gillius.org> <470D5167.8000200@gillius.org> <474F3DAB.6030603@gillius.org> Message-ID: Excellent, thank you for the detailed response. That makes a lot of sense. I'm going to try another Windows trial... I did manage to compile on Linux and run the program. When I tried to do it on a test database, I got a "file not recognized" error (don't have the text in front of me). When I looked up this error on google I found a conversation from someone who was trying to migrate on a Mac and began a discussion on endian byte order. I thought this might be my issue as well but my colleague (helpful fellow, him) said that it's processor-specific - Intel Linux will have same byte order as Intel Windows. The only other variable I know about is that our Linux box is 64-bit, but apparently that doesn't matter either. What do you think? thanks again for time and expertise! PS don't forget to CC the list! On Nov 29, 2007 5:31 PM, Jason Winnebeck wrote: > Your colleague is entirely right, on one aspect. The code probably runs > just > as fast on the Linux box as on my desktop. Actually, the code is probably > slower on Linux, in execution speed because the Linux machine is actually > about 4 years old and I think it's something like a 2ghz dual core HT > setup, > but since vss2svn is single-threaded it only runs in one processor anyway. > > The problem is that the conversion isn't a CPU-bound process, it's > IO-bound. > Therefore the speed is limited to the disk access. So really what I am > comparing is filesystem I/O in Windows vs Linux and Linux seemed to do a > lot > better with this job of extreme amounts of small, fragmented access. Of > course > on typical Windows workstations you have anti-virus and loads of IT "crap" > now > and just having McAfee virus scanner enabled slowed the process by several > times. > > If you can do a RAM drive on Windows, if you can use SCSI disks with IO > queueing, or etc, you can get benefits. Actually, I wonder if a USB drive > would be faster than an HD because of the random access of very small > chunks > of data has nanosecond overhead on USB drives but milliseconds on > mechanical > drives. > > Anyway, it's not worth a huge deal to get it over. If it takes a day in > Windows and 5 hours in Linux then it's not worth it. I definitely wouldn't > set > up a Linux machine JUST to do this. But you can try a few things on > Windows, > like USB or whatever and it will be obvious if it is going very fast or > very slow. > > In my plan I actually just started it on Windows and then tried to find > faster > ways and I was actually able to run the solution on my Linux server and > finish > it before the Windows one was hardly kicked off so I just stopped the > Windows > one, again mostly due to RAM disk (which is standard in Linux). > > Jason > > David Blaikie wrote: > > Hi again Jason, follow-up question re your suggestion to run VSS2SVN on > > Linux to improve speed. > > > > I ran this idea by a colleague and he felt that, since the core > > functionality is compiled C, that it shouldn't run much faster on a > > Linux machine. Do you have any idea why this would have been the case > > for you? Was it because your Linux machine was just faster, or because > > you were using a RAM disk? > > > > Just because of our own hardware setups, it would take a great deal more > > time and trouble for us to move our repository to a Linux machine and > > would be easier to do so on a Windows machine. I would like to get more > > information before going forward with the Linux idea. Can you or anyone > > else on the list offer any more thoughts on this subject? > > > > thanks > > > > David > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.pumacode.org/pipermail/vss2svn-users-lists.pumacode.org/attachments/20071129/4ce13e96/attachment.html From ldavis at fonix.com Fri Nov 30 15:39:49 2007 From: ldavis at fonix.com (Leo Davis) Date: Fri Nov 30 15:39:58 2007 Subject: Fwd: Memory error In-Reply-To: References: <470D2101.20005@gillius.org> <85ADF0B17B14A64A973404FBC0162F7B06FAD05F@NYC-EXCLS2.dc1.doubleclick.corp> <470D437A.9040403@gillius.org> <470D5167.8000200@gillius.org> <474F3DAB.6030603@gillius.org> Message-ID: <47507515.7080703@fonix.com> David Blaikie wrote: > Excellent, thank you for the detailed response. That makes a lot of > sense. I'm going to try another Windows trial... > > I did manage to compile on Linux and run the program. When I tried to > do it on a test database, I got a "file not recognized" error (don't > have the text in front of me). When I looked up this error on google > I found a conversation from someone who was trying to migrate on a Mac > and began a discussion on endian byte order. I thought this might be > my issue as well but my colleague (helpful fellow, him) said that it's > processor-specific - Intel Linux will have same byte order as Intel > Windows. The only other variable I know about is that our Linux box > is 64-bit, but apparently that doesn't matter either. What do you > think? > Actually, it does matter. I have a dual boot box with both 32 and 64 bit copies of the Linux OS. I built and installed the current trunk on both OSes. The migration runs to completion on the i586 OS. When I run the migration on the x86_64 OS the migration fails almost immediately: ssphys: unrecognized file Try `ssphys --help` for more information ERROR -- FAILED with non-zero exit status 255 (cmd: "ssphys" info -ewindows-1252 "/path/to/database/data/names.dat") at /usr/bin/vss2svn.pl line 1481 File does not exist: at /usr/bin/vss2svn.pl line 130 ssphys seems to have problems when built for 64-bit Linux. Leo From dbb14 at columbia.edu Fri Nov 30 16:15:04 2007 From: dbb14 at columbia.edu (David Blaikie) Date: Fri Nov 30 16:15:12 2007 Subject: Fwd: Memory error In-Reply-To: <47507515.7080703@fonix.com> References: <470D2101.20005@gillius.org> <85ADF0B17B14A64A973404FBC0162F7B06FAD05F@NYC-EXCLS2.dc1.doubleclick.corp> <470D437A.9040403@gillius.org> <470D5167.8000200@gillius.org> <474F3DAB.6030603@gillius.org> <47507515.7080703@fonix.com> Message-ID: eek. This is the same error I was going to bring up next - the error I got when migrating a small database! Looks like I'm out of luck, then! Anyone have any idea why this should be so? Why should vss2svn have trouble on 64? David On Nov 30, 2007 3:39 PM, Leo Davis wrote: > David Blaikie wrote: > > Excellent, thank you for the detailed response. That makes a lot of > > sense. I'm going to try another Windows trial... > > > > I did manage to compile on Linux and run the program. When I tried to > > do it on a test database, I got a "file not recognized" error (don't > > have the text in front of me). When I looked up this error on google > > I found a conversation from someone who was trying to migrate on a Mac > > and began a discussion on endian byte order. I thought this might be > > my issue as well but my colleague (helpful fellow, him) said that it's > > processor-specific - Intel Linux will have same byte order as Intel > > Windows. The only other variable I know about is that our Linux box > > is 64-bit, but apparently that doesn't matter either. What do you > > think? > > > Actually, it does matter. I have a dual boot box with both 32 and 64 > bit copies of the Linux OS. I built and installed the current trunk on > both OSes. The migration runs to completion on the i586 OS. When I run > the migration on the x86_64 OS the migration fails almost immediately: > > ssphys: unrecognized file > Try `ssphys --help` for more information > ERROR -- FAILED with non-zero exit status 255 (cmd: "ssphys" info > -ewindows-1252 "/path/to/database/data/names.dat") > at /usr/bin/vss2svn.pl line 1481 > File does not exist: at /usr/bin/vss2svn.pl line 130 > > ssphys seems to have problems when built for 64-bit Linux. > > Leo > > _______________________________________________ > vss2svn-users mailing list > Project homepage: > http://www.pumacode.org/projects/vss2svn/ > Subscribe/Unsubscribe/Admin: > > http://lists.pumacode.org/mailman/listinfo/vss2svn-users-lists.pumacode.org > Mailing list web interface (with searchable archives): > http://dir.gmane.org/gmane.comp.version-control.subversion.vss2svn.user > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.pumacode.org/pipermail/vss2svn-users-lists.pumacode.org/attachments/20071130/908cfe0b/attachment.html From dbb14 at columbia.edu Fri Nov 30 16:15:36 2007 From: dbb14 at columbia.edu (David Blaikie) Date: Fri Nov 30 16:15:38 2007 Subject: Fwd: Memory error In-Reply-To: References: <470D2101.20005@gillius.org> <470D437A.9040403@gillius.org> <470D5167.8000200@gillius.org> <474F3DAB.6030603@gillius.org> <47507515.7080703@fonix.com> Message-ID: my mistake - ssphys has the problem... On Nov 30, 2007 4:15 PM, David Blaikie wrote: > eek. This is the same error I was going to bring up next - the error I > got when migrating a small database! Looks like I'm out of luck, then! > > Anyone have any idea why this should be so? Why should vss2svn have > trouble on 64? > > David > > > On Nov 30, 2007 3:39 PM, Leo Davis wrote: > > > David Blaikie wrote: > > > Excellent, thank you for the detailed response. That makes a lot of > > > sense. I'm going to try another Windows trial... > > > > > > I did manage to compile on Linux and run the program. When I tried to > > > > > do it on a test database, I got a "file not recognized" error (don't > > > have the text in front of me). When I looked up this error on google > > > I found a conversation from someone who was trying to migrate on a Mac > > > > > and began a discussion on endian byte order. I thought this might be > > > my issue as well but my colleague (helpful fellow, him) said that it's > > > processor-specific - Intel Linux will have same byte order as Intel > > > Windows. The only other variable I know about is that our Linux box > > > is 64-bit, but apparently that doesn't matter either. What do you > > > think? > > > > > Actually, it does matter. I have a dual boot box with both 32 and 64 > > bit copies of the Linux OS. I built and installed the current trunk on > > both OSes. The migration runs to completion on the i586 OS. When I run > > the migration on the x86_64 OS the migration fails almost immediately: > > > > ssphys: unrecognized file > > Try `ssphys --help` for more information > > ERROR -- FAILED with non-zero exit status 255 (cmd: "ssphys" info > > -ewindows-1252 "/path/to/database/data/names.dat") > > at /usr/bin/vss2svn.pl line 1481 > > File does not exist: at /usr/bin/vss2svn.pl line 130 > > > > ssphys seems to have problems when built for 64-bit Linux. > > > > Leo > > > > _______________________________________________ > > vss2svn-users mailing list > > Project homepage: > > http://www.pumacode.org/projects/vss2svn/ > > Subscribe/Unsubscribe/Admin : > > > > http://lists.pumacode.org/mailman/listinfo/vss2svn-users-lists.pumacode.org > > Mailing list web interface (with searchable archives): > > http://dir.gmane.org/gmane.comp.version-control.subversion.vss2svn.user > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.pumacode.org/pipermail/vss2svn-users-lists.pumacode.org/attachments/20071130/77a96ad2/attachment.html From gillius-ml at gillius.org Fri Nov 30 16:18:44 2007 From: gillius-ml at gillius.org (Jason Winnebeck) Date: Fri Nov 30 16:18:52 2007 Subject: Fwd: Memory error In-Reply-To: References: <470D2101.20005@gillius.org> <470D437A.9040403@gillius.org> <470D5167.8000200@gillius.org> <474F3DAB.6030603@gillius.org> <47507515.7080703@fonix.com> Message-ID: <47507E34.6090802@gillius.org> Maybe it does something silly like assume sizeof(int) = 4 bytes? I don't know, on modern compilers was the decision made that int should become 8 bytes (64 bits wide)? I know that size of pointers would have to change, but if it is trying to do IO based on pointer sizes that would be really out there. Jason David Blaikie wrote: > my mistake - ssphys has the problem... > > On Nov 30, 2007 4:15 PM, David Blaikie > wrote: > > eek. This is the same error I was going to bring up next - the > error I got when migrating a small database! Looks like I'm out of > luck, then! > > Anyone have any idea why this should be so? Why should vss2svn have > trouble on 64? > > David