Sloejack Mods to JnF's SWGC Crafting Tool v1.66
 

Current Version: v1.66.9

Current Fully Supported Professions: Armorsmith, Artisan, Architect, Bio-Engineer, Chef, Combat Medic, Doctor, Droid Engineer, Entertainer, Jedi Initiate, Jedi Padawan, Medic, Musician, Smuggler, Tailor, Ranger, Scout, Shipwright, and Weaponsmith

Known Issues:

• High end ship schematics use 8 different resources, the tool only supports up to 7

Planned Changes:

• General Re-Write for efficency and overall tool improvements

Comments (12/13/04): Added Poison & Disease Area Cures as well as Poison & Disease Resist Enhancement schematics to the tool for doctors. I also performed some minor editing to correct misspellings or typos that were identified by users. I also modified my disclaimer below.

*** Begin Disclaimer ***
I'm a hacker. I didn't write this tool, I've only modified it beyond it's current official state to adjust to changes within the game and with SWGC itself. I am not planning to develop this version of the tool any further with new features. I will however support the changes that I have made and continue making modifications that are within the realm of keeping in sync with the game until the new tool is completed.

As I make significant changes I will post an update here and re-upload the current version of the tool to the link to the current version. This zip file only contains my modified version. If you are looking for the original from Jenner please see the first post in the original thread, "Jenner and Fooman's SWGC Crafting Tool v1.66"

To use this tool, you must be running Excel 2000 or later. Additionally to be able to use the "What To Harvest Today" sheet properly, you will need to install the zlib.dll (included in the zip file) before the tool can manipulate the data provided by SWGCraft.
*** End Disclaimer ***

Problem #1.

Weaponsmith is not a selectable profession from the Configure Tool option. Although all schematics are on the Data All sheet.

I am starting to think there is something wrong with the download format. I tried your version, Jenner's 1.66 and the one I'm running now (1.63) and my download isn't working right on any of them.

What galaxy are you downloading for? I used Ahzai for my test (since it was one that I knew had all of the JtL resources listed in it as currently available). My tests worked successfully with that galaxy but I don't discount what you're saying, just not seeing the same results.

This one, I can not explain. I made no changes to the code, but did clear the active professions and then cut weaponsmith and inserted it before tailor on the professions sheet. I then checked the code to make sure I made the change I thought I did. Saved it all and it appeared just above tailor in the list like it is supposed to. I then cut Tailor and re-inserted it above weaponsmith, saved, reloaded, and then all 22 professions were in the list as expected. Sorry I don't have a more technical response as to what caused it or how I fixed it but it's better now.

I've uploaded a version that works since there's no guarantee that the fix I just described would work, it's only there to explain how I resolved it.

This is interesting. I downloaded the tool and copy/pasted everything from the old versions into this version and it looked good until I went to test out some weapon schems. On Flame Thrower I got a message saying I didn't have any liquid petro fuel to make a flame thrower... Went to the resources page and saw 3 entries for class 2 and 3 liquid petro. Updated the tool any way I could and tried it again. Still no dice.

Any ideas? :)

Great of you to pick up the gauntlet on the crafting tools, btw.

Someone asked about the Ranger and Jedi Schematics/Professions in the other thread. I believe the Jedi schematics were removed because they were out of date after the Jedi revamp. I don't have the skills to address this so I will not be doing so. If a Jedi would like to contribute the schematic information, I would be happy to add it to the tool.

The issue with the Ranger profession isn't known yet. It's not a profession I focused on while doing my changes but one thing I noticed in a quick look at it was the Tatooine Camo Kit schematic, has Tatooinian Reptile Meat, it should be Tatooinian Reptillian Meat. I don't believe this fixes Ranger as far as selecting a profession but I'll continue to look into it and see what I can find if anything.

Hmm, I do not have any ideas. I just tested with the 1.66.3 version which has some default resources in it (stuff I've collected while beta testing) added weaponsmith as a profession and then selected the flamethrower schematic.
I did not catch any notice of missing resources, in fact the specifics that it recommended (from my default resources) were:

Cihi (Kammris) for the Iron
Trileehiism (Class 4 Liquid Petro) for the Liquid Petro Fuel
Durtetrakaigariceiic (Polysteel Copper) for the Metal
Gacelfatei (Hardened Arveshium Steel) for the Steel

Is it possible you have a typo in your resources? When you look at your resources sheet, are the lines with your liquid petro red?

Very nice mod, Sloejack. I tried to do a bit of this with jenner's tool and kept hitting walls.

v1.66.4 Push
 

Since SOE is turning off the Beta tomorrow morning I've updated the ship chassis experimentation as well as correcting the incorrect resource in the Ranger Tatooine Camo Kit schematic. I've pushed out 1.66.4 but if you don't wish to download it, you can make the corrections/adjustments by hand against the data all sheet.

been following your work, and have turned many people to this tool.

just giving a high five for the ship mods. well done.

free stuff if you play on tarq :D

My bad, I figured it out. I had neglected to copy over the 'Use as generic type', 'price per unit' and 'min quantity' for those resources, so it was not really seeing them. Interesting.

Thank you for the suggestions though. It made me look a little closer.

Keep up the good work.

Had some big trouble with v1.66 today. Seem the CSV file wouldn't update the WTHT list (only got 1 type of resource all over..). Then I tried v1.66.4 and everything is working fine... Thx Sloejack

Not sure exactly what's going on with all the N/A's and some resource stats not coming up. I also noticed that I was having a problem downloading the current CSV file. Not sure if it's the tool, since some people seem to have the same problems as me, and some do not. I just downloaded v1.66.4 at work and it seems fine.

One thing I did notice, and I'm not sure if this is a problem or not... I'm wondering if it might be the new Windows Service Pack. I noticed my tool malfunctioning after I updated my Windows files. I haven't downloaded system updates here at work, and the tool works fine, but I updated at home, and it's all screwy.

Just wondering if anyone else was noticing something similar?

I haven't experienced it personally but if you're thinking it's connectivity problems, you might look for the little box that pops up asking if you want to let an app access the internet. Beyond that, I'm not sure what to suggest.

Actually, the freezing of the 1.66 tool seems to be related to the new mineral types that the tool isn't designed to handle. Crystallized Biwhatever steel and so on.

Appriciated, however since I'm currently crawling the Jedi Path on Scylla I'll have to pass on your generous offer.

Yeah, good job Sloejack! Not only did you improve the tool, you are doing a bang up job of supporting your mod when problems arise.

/cheer Sloejack

Tool no longer works
 

Very sorry about this, but since Sunday, or possibly before, this tool no longer works.

Started getting problems with it saying that I had the most recent update and have now ascertained that although the data has been downloaded into the SWG Parsed sheet, the data in the WTHT spreadsheet is no longer updating. Consequent to this as the data has become more out of date the WTHT Summary page now shows all N/A's, since the resources are no longer present on the SWG Parsed page.

Seems to me that the macros are stopping halfway through. Another clue to this is that the cursor stays with the hourglass symbol although there is no lockup.

Really frustrating since up until recently this tool has been so very, very useful.

I think you must be talking about Jenner's version. Honestly, I've noticed your posts, but I don't think you're reading what everyone else is posting, me included.

Sloejack,

Many thanks, just downloaded your version 1.66.4 and everything now seems to be working fine.

Great job, thanks.

I've had a problem with these tools for a while and have been trying off and on to figure it out. Up until today it has been limited to 1 schematic so it hasnt been a big deal, but today I noticed its more widespread.

Before that though, thanks to everyone who's done work on these tools. invaluable. Simply invaluable.

My problem is it doesnt seem to be handling the %'s for cd or oq correctly. let me use advanced blaster power handlers as an example, which is the one thats been giving me problems for a while.

Under Data it has listed 66.66666667% cd and 33.33333333%oq

under the what to harvest today tab it lists it as 83%cd and 13%oq

in the actual schematic it lists them as 66 and 33 correctly, but it isnt calculating correctly. It is weighing more heavily on the cd than it should be. I didnt actually calculate it out, but I think its weighing them more like 83/13 what it lists in the what to harvest today tab.

I'm really at a loss here. I've looked through the code and I got somewhat lost. It looked to me it gets all these weights from the data, but the data is entered correctly, and i have all these skewed weights. I have some resources listing 54/46 when they should be 50/50, one 70/30 etc. I didnt actually calculate these out, but its sure makes me wonder.

Anyone have any ideas?

(I do not in anyway believe this problem is related to this version as i've had this problem back with 1.64a, but this is the most active thread)

Thanks in advance for any thoughts.

I had the same problem. I asked in the old thread around page 50. I was told that they are different to accomodate the resources that do not have that stat.

I found the answer I got here it is:

The reason for this is that inert gas doesn't have a conductivity value, so the relative weights change for the entire schematic. Jenner put a lot of number crunching in a while back to correct all the formulas to account for items that don't have the stat the schematic calls for.

interesting, but since they added the ability to test out resources when making things I know for sure at least this schematic is wrong. To test out a resource I mean to click it when making things and it tells you how good it will be with a bar and numbers. I spent some time with it and in fact my number 2 resource according to the tool is better according to the game. Several percent better in fact and it gives better assembly results.

But thanks for the reply, that at least gives me a starting point to trying to fix it.

Unfortunetly this isn't an apples to apples comparison. The 'test' in the game with the crafting tools takes more into account when rating a material than this tool does. This probably because it's applying all of the relavent stats of a resource against all of the relavent experimentation fields of the object you are crafting. In general this is a good thing. In practice may be a different case. Perhaps you have a material that has good stats in all 4 areas that your object cares about, that resource will be rated higher than a resource that has 2 stats that are awesome and the other two that are crap. However, for what you're making you really only care about the two awesome stats. Which is really better? *shrug* I'm not trying to answer that question, I'm only suggesting that there is a lot more to the crafting formula and practice than meets the eye.

ABPHes are funny like that. The fact is CD is MUCH more heavily weiged than the OQ because so few units of resources carry the CD stat.

Calculation for PERFECT ABPH:

ABPH: CD67 OQ 33

Total units: 44

Units carrying CD 13
Units carrying OQ 44

As you can see, CD is rare among the resources, as such it will have a much heavier weight in each resource than OQ.

Diatium CD 794 79.4% of 5 CD = 3.97 CD
Diatium OQ 1000 100% of 5 OQ = 5 OQ

Irolunn OQ 1000 100% of 16OQ == 16 OQ

Ostrine OQ 1000 100% of 5OQ == 5 OQ

Phrik CD 800 80% of 8 = 6.4 CD
Phrik Average 100% of 8OQ = 8 OQ

Polymer OQ 1000 100% of 10OQ == 10 OQ


OQ Total 44/44 = 100%
CD Total 10.37/13 = 79.769%

Look at the weighting on Phrik Aluminum:


Phrik

CD Resulting OQ Result
800 86.513 800 85.301
780 85.692 780 85.179
760 84.872 760 85.058
740 84.051 740 84.937
720 83.231 720 84.816
700 82.41 700 84.695

%Diff 4.103 %Diff 0.606

For a 100 point drop in CD you lose 4% in the final combine. The same 100 points of oq drops you .606%

Thats a MUCH larger differance than 66/33, but it's fact. 83/13 is pretty close to the actual weighting for Phrik aluminum in the ABPH.

Before you make guesses about which materials are better/worse than others, then I would suggest actually making 2 ABPH's with all resources the same except the 2 you are comparing. Not trying to flame you or anything, its just that I've done it and even though the new bars may report green/yellow on some resources, the real proof is the final stats and/or final experimentation percentage.

If you are comparing two resources that are very close, you may not notice any difference in stats but usually you will see a difference in the final experimentation percentage (even though its rounded off to the nearest whole number). The spreadsheet's formulas do seem to work correctly and will produce an accurate final experimentation percentage which you can compare to the game's experimentation percentage which the crafting tool reports to you while experimenting on damage/speed. My ABPH's come out to 82.6% on the spreadsheet and 82% in the game using my best resources. If I drop down to #2 best copper, I get 81.6% on spreadsheet and 81% in the game. So, from my experience, the formulas do work as-is.

Occasionally I will notice a discrepency between the WTHT page and the schematic page on which resource is best and second-best. Generally, the schematics page is correct, but you can always experiment and find out for sure. The one thing I would consider unreliable is the new in-game green/yellow/red bars that show up next to resources in the crafting tool. These don't account for capped resources, and I don't think they work correctly for split experiment values other than 50/50. For instance, 66CD/33OQ resources they don't seem to evaluate correctly. So, in my opinion, the new bar's are not a reliable measure.

BTW, 83/13 does not add to 100, so its actually 86.6/13.3 I think. These foruma's have been rounded just a bit by Jenner/Fooman so I think if there is any discrepency between the WTHT page and the schematics page, its just due to rounding and the #1 and #2 resources are probably super close in stats so it probably won't matter anyway.

As far as I know, the way the engine works for the schematics page, it calculates all possible combinations of resources you have that fit the requirements of the schematics, and then sorts them by final percentage. So, the final experimental percentage is the key in determining which resources are best, and the ranks of the resources are determined after the calculations by which percentages were highest for each resource.

For instance, it would probably work best if the spreadsheet could do this:
Best overall: Resource A, Resource C - 95.5%
Second best: Resource A, Resource B - 95.2%
Third best: Resource D, Resource B - 95.1%
Fourth best: Resource D, Resource C - 94.9%

In this example, resource B and C flip back and forth for which is higher rank and it should list C and #1 and B as #2 except that for the fact that B has better stats than C when combined with resource D. So in this case, its possible for resource B to be ranked #1 on the WTHT page instead of resource C. In reality, they are close enough that in-game experimentation shows them to be the same.

Also, last but not least, due to rounding, resources within 1% of each other usually are identical in in-game experimentation. So, for instance, a 990SR steel and a 999SR steel will produce the same ending stats (99% experimentation). When you have two stats to complare, like CD/OQ, then you add them and divide by the percentage - 50CD/50OQ for a 1000CD/800OQ copper would be 900 average stat. Any other resource that ended up with stat between 900 to 909 would work the same. Due to this rounding, its possible again to get combinations of resources that seem out of order because the stats add up to a higher number for one resource than another, so the spreadsheet schematics lists them backwards. Again, this may be due to rounding and in actuality they come out equal when trying them out in-game.

Sloejack can you modify your first post (at the top of the page) to include the link to your download.

Thx
Da_Nah

Done.

And now I'll add some more words so the message will actually post. :)

SloeJack,
Most everything is working great. One thing I noticed though. When downloading the current resouces (in my case on Naritus), everything shows up on the WTHT sheet except the Hardened Arveshium Steel. I check the SWGCraft Resource lists and it is in it's proper spot. However, when I scan the SWGCparsed page I don't see it all. All the SW specific ones are there but this one doesn't look like it's getting parsed correctly.

I'll look into this when I get home this evening. Is anyone else seeing this on any other galaxy? I have to say I may not have looked too closely during testing since I was more focused on fixing the +/- % numbers.

...

Here is the exact situation I am having.

Adv. Blaster Power Handlers

The tool says this is #1 @ 70.8% max exp (I have removed the quantity in stock and the redundant material specifier. I also added Malleability for the sake of future arguments).

This schematic uses 67% CD and 33% OQ

Type Quant Name CD OQ (MA)
Diatium Copper 5 Piweu- 786 625
Irolunn Gas 16 Metho- 0 248
Ostrine Ore 5 Iges 0 441
Phrik Aluminum 8 Riri 784 645 (906)
Polymer 10 Diso- 0 996

with #2 Phrik is 70.4% max exp.
Phrik Aluminum 8 Omni- 728 955 (942)

comparing the 2 resources 67% CD 33% OQ

Riri = .67*784+.33*645=525.28+218.85=738.65
Omni-= .67*728+.33*955=487.76+315.15=802.91

During my assemblies, as mentioned in my first post, I get consistently, in fact in this case I would say 100% of the time, better results with Omni-. Is it the 36 higher MA doing it? I doubt it, but I dont know.

From the replies you guys are giving it is clear the tool is using the gates to get "adjusted" %'s for comparing. Sounds good, but look at this. If I follow correctly the tool is doing this more or less.

Riri = .67*(784/800)+.33*(645/1000)=.6566+.21285=86.945%
Omni- = .67*(728/800)+.33*(955/1000)=.6097+.31515=92.485%

So, even if it is doing this, why is it not reporting Omni- as better?

And yeah it says in wtht 87/13 not 83/13. My apologies.

I still think its giving too much weight to cd. From the first reply I got (thank you for the civil reply btw) maybe its doing this because 3 of the resources required dont even have CD.

I truly don't know what is going on. I do know that its mistaken in this case and I was simply asking for some advice on how to fix it. I wrongly linked the 87/13 on the wtht page with this problem. Very well could be totally unrelated, but it looks fishy to the untrained eye, and would explain the weighing of CD more heavily.

I hope this gives a bit more information and will perhaps lend a wee bit more credence to my issue.

IMHO Jenner is going to have to respond to this when he gets free from RL issues and can explain it. Maybe even Fooman since I remember long discussions and number crunching on the issue of components with resources that don't have a particular required stat. We all experimented and the tool was changed to the current resources ratios something like 9 to 10 months ago.

SloeJack has been working on configuring the tool for Shipwright (and done a stellar job too, thanks dude :) ) If we are going to tinker with the resource ratios we need to do it with the input of the individuals who analyzed this to death when the tool was developed. I'm not saying the existing ratios are perfect, just that a great deal of thought and research went into those figures. We need that legacy info before changing things around. Especially considering we have several sub-components in the same situation (those with radioactive or reactive gas have PE as a stat but all the other resources don't have it). When JTL goes live we'll all have to play with different resources and see how experimentation works.

yeah I understand, and I'm not trying to make everyone agree or disagree with my theory. Honestly I was hoping this was an old issue I was seeing and I had done something wrong.

Anyhow I've got a plan, now to dive into the program and bend it to my will.

/cheers

Ok, so the reason I didn't see a problem with my tests against the Ahazi server is because it shows up on the SWGCparsed sheet, and on the What to harvest Today sheet since I blanked out my resources and oddly enough on ahazi it shows up as a good source for a lot of shipwright schematics. I looked at the downloaded CSV sheets in my temp directory and the thing I noticed about the naritus DL is that the Hardened Arveshium is the last item in the sheet. This makes me wonder if perhaps there has been an ongoing issue where the last resource on the downloads is not being parsed (or parsed properly). A quick check of the Ahazi file shows a yavinian wooly hide as the last item in the sheet and sure enough, it is not in the SWGCparsed sheet. So... the last line isn't being parsed... since I didn't mess with any of the parsing, I can only assume this has been the case for some time. I'll take a look at the code and see if it is something I can fix.

*EDIT*
Ok, the parse code is pretty straight forward, it is after all, just a comma delimited file. I'm still digging, but I'm betting that the last line doesn't have a newline or carrige return at the end of it and instead of dumping the line and parsing it, it's ending the loop and never reading it into the array. So my question to any possible excel/macro gurus is, have you encountered something like this before when dealing with the last line of a file input that has no newline or c-return, and if so, how can I resolve this? The code in question looks like this:

*EDIT 2*
Never mind that jive about no newline or return on the last resource, in looking at the files in a text editor, there's actually a couple of blanks. Never the less, the last line is still not being parsed for some reason.

*EDIT 3*
No solution yet, but I'm fairly certain it has something to do with the fact that the routine assumes no linefeeds in the csv file. In looking at it with a textfile viewer, I do not believe this is the case (it may have once been) and the 'read' function is not catching the last line when he basicly streams the whole file and then uses the step function to grab each group of 24 items. I'm going to try and re-write this to see if I can do it but the first time through I started getting errors about it not being able to even uncompress the file so I'm not sure how that happened since I don't see that function being called anywhere here.

*EDIT 4*
After four hours I've made no progress. There's something about the way the compressed file is handled and handed off to the GetCurrent routine that I don't understand. I'll try some more tomorrow, but this should serve as a general warning. For all galaxies, whatever the last resource is at the bottom of the uncompressed csv file is, it is not being loaded into the tool.

On The WTH Summary page at the very end it is not listing about 10 resources. Is there a hard cap on the number of resources it will show on the sumary page. I currently have the Program set upf ro WS / Chef.

I had noticed the problem with extra resources listed on the WTH page, even back when I was running version 1.64a. On my page cureently with version 1.66.4 I am seeing 61 resources on WTH and total line items of 74....so missing about 13 from the table, that have just the names showing.

I never used the WTH page much so never noticed when/ what version it started to appear.

I notice the same thing with the WTH Summary. It only shows 61 items with the rest just being resource names. I tried inserting rows anc copying columns c-r ... no change. It still just goes to line 61.

I just started using this with Sloejacks mod (1.66.1) so I can't say how far back it goes.

Hmm, this is probably why Jenner was looking to re-write these functions. I'll continue looking at it, but I can't promise any solution in the near term since you're talking about really writing VBA stuff as opposed to just altering some numbers and cleaning up data entry.