Home World Forum
Stars! AutoHost web forums

Jump to Stars! AutoHost


 
 
Home » Stars! 2.6/7 » The Bar » h files merger? possible issues?
icon5.gif  h files merger? possible issues? Fri, 11 February 2011 13:44 Go to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

I need an input/comments/suggestions and especially objections if any from the field on possible h files merger tool. What I'm think of is a simple merger.exe, that being run against two h files (like "merger game.h1 game.h2") will read all the planets stat data from the first one and append it to the second one (currently only planets data, but things like Designs and Scores could be also merged later). Let's imagine I can create such a tool (I have just merged one of the planet data from one h file to the another h file manually, so in general it works). Can someone imagine any cheating possiblity there if such a tool will be publically available (with no sources of cause)? Cool

[Updated on: Fri, 11 February 2011 13:45]




"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Fri, 11 February 2011 13:51 Go to previous messageGo to next message
donjon is currently offline donjon

 
Lt. Commander

Messages: 808
Registered: November 2002
Location: Benque Viejo del Carmen, ...

Hi,

It seems to me that Orca (or someone from the Stars! IRC channel) has already made this application.

Smile

Report message to a moderator

Re: h files merger? possible issues? Fri, 11 February 2011 13:51 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

Where is it? It would be nice to have it, but I cannot find one.


"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Fri, 11 February 2011 13:59 Go to previous messageGo to next message
nmid

 
Commander

Messages: 1608
Registered: January 2011
Location: GMT +5.5

I've been scavenging the forums A LOT!!
I don't think something that can merge H file data into stars is available.

If it is, please do post the link Smile

http://starsautohost.org/sahforum/index.php?t=msg&th=453 7&start=6

http://starsautohost.org/sahforum/index.php?t=msg&th=453 7

Micha wrote on Fri, 16 July 2010 16:35

Quote:

Now to see if I can add other player's .h data directly into my stars game...

Good luck with that. Wink There is (at present) no util that can do that for you. It's on the top of my wish list for all the +10 years that I'm playing this great game.

mch




I know my minefields.. but I'm a chaff sweeper.
I used to curse when I got stuck in traffic... till I realised I AM traffic.

Report message to a moderator

Re: h files merger? possible issues? Fri, 11 February 2011 14:02 Go to previous messageGo to next message
donjon is currently offline donjon

 
Lt. Commander

Messages: 808
Registered: November 2002
Location: Benque Viejo del Carmen, ...

It wasn't Orca, it was Wumpus... he had a webpage where you took the h-files and it would merge them into one.

Smile

(it was a few years ago though)

Report message to a moderator

Re: h files merger? possible issues? Fri, 11 February 2011 14:17 Go to previous messageGo to next message
donjon is currently offline donjon

 
Lt. Commander

Messages: 808
Registered: November 2002
Location: Benque Viejo del Carmen, ...

Chuckle...

You started me digging...

at http://stars-util.sourceforge.net/olds.html

Quote:

2005-03-06 - michaelz_wumpus : Team knowledge pooling.
Some time ago, I patched together an H file combiner and beta tested it for some teams in the ringsm game. It became moderately polished in that time, and now only really lacks a web service front end (I still don't feel able to release the binaries, let alone the source - see the update on the 10.10.2004). But that's work I find interminably boring, so the X file checker mentioned in the update below is going to get more attention for a while.

If someone feels like working on this, I can write up a spec for what I need; it's fairly simple... Just e-mail me at Michael "Wumpus" Zinn <*****>.


email addy at link Smile

Report message to a moderator

Re: h files merger? possible issues? Fri, 11 February 2011 17:13 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

OK, donjon, thanks for pointing me. It looks like writing the new merger would be a kind of "reinventing the wheel".

But as of h merger by wumpus there is one thing that I'm really cannot understand and this is why I started this thread.
wumpus

...I still don't feel able to release the binaries...


I completely understand the reason to not publish encoding/decoding algorithm (and btw it's sounds funny, since it's already publically available on this site, I cannot post a link here, since I beleive it will resulted in banning my SAH account forever, but beleive me it is published on the SAH for more than a year at the moment and it's not published by me).

But what is the reason to not publish compiled merger.exe? What kind of cheats it can cause? Did I miss something?



"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Fri, 11 February 2011 17:20 Go to previous messageGo to next message
donjon is currently offline donjon

 
Lt. Commander

Messages: 808
Registered: November 2002
Location: Benque Viejo del Carmen, ...

XyliGUN wrote on Fri, 11 February 2011 16:13

OK, donjon, thanks for pointing me. It looks like writing the new merger would be a kind of "reinventing the wheel".

But as of h merger by wumpus there is one thing that I'm really cannot understand and this is why I started this thread.

I completely understand the reason to not publish encoding/decoding algorithm (and btw it's sounds funny, since it's already publically available on this site, I cannot post a link here, since I beleive it will resulted in banning my SAH account forever, but beleive me it is published on the SAH for more than a year at the moment and it's not published by me).

But what is the reason to not publish compiled merger.exe? What kind of cheats it can cause? Did I miss something?


Wumpus was very adamant on saying the encrypt/decrypt function was not very tricky. He was worried about the function becoming available... rightly so... likely it is already available. But, really; Wumpus is the one you need to talk to. You can either contact him at his email address (which I believe is still functional) or if you can find him active at irc #Stars!

regards,
les

Report message to a moderator

Re: h files merger? possible issues? Fri, 11 February 2011 19:39 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

Well, I was talking to wumpus last summer when I was trying to figure out Stars files structure and from his answers I know that he is really "very adamant" of keeping decryption/encryption from being published. And I'm OK with that. I'm agree that publishing decryption could hurt a lot.

What I'm trying to find out is if there are any resonable points to hide compiled tools from those who would really like to use them without cheating and the most important thing can someone imagine how people can cheat having h file merger?



"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Sat, 12 February 2011 08:28 Go to previous messageGo to next message
m.a@stars is currently offline m.a@stars

 
Commander

Messages: 2765
Registered: October 2004
Location: Third star to the left
XyliGUN wrote on Sat, 12 February 2011 01:39

can someone imagine how people can cheat having h file merger?

Decompile it, isolate the relevant un/encrypting functions, apply liberally elsewhere... Evil or Very Mad

The best way to keep it from happening is Wumpus' way. Obfuscation and other anti-decompiler techniques *might* work, but you'll never know for sure. Actually, no-one knows for sure whether anyone might be using these algorithms already for nefarious purposes. Shocked

And the only other way to keep cheaters at bay would be a server-side "feeder" tool that scans all x-files and "sanitizes" them before letting the server go at them. Whip

Some work has already been done in tools like that, including at least one that can also plug some of the better-known bugs. Cool



So many Stars, so few Missiles!

In space no one can hear you scheme! Deal

Report message to a moderator

Re: h files merger? possible issues? Sat, 12 February 2011 12:16 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

XyliGUN wrote

can someone imagine how people can cheat having h file merger?
m.a@stars wrote

Decompile it, isolate the relevant un/encrypting functions, apply liberally elsewhere... Evil or Very Mad

Those, who have enough knowledge to decompile/disassemble merger.exe could also decompile stars.exe itself, so it looks like there is no additional help to cheaters in publishing merger.exe.

Any other issues in h file merger except possible decompiling?



"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Sat, 12 February 2011 20:04 Go to previous messageGo to next message
craebild is currently offline craebild

 
Lieutenant

Messages: 568
Registered: December 2003
Location: Copenhagen, Denmark
Not so much an issue with making merger.exe available, more a question of what it does...

Has there been done any testing how Stars! reacts to the merged H file ?

How does it handle "double" information like different information on a planet from two different players (and different years of course), and if the players have both seen ships based on the same hull type and with the same mass ? Two ships with the same hull and mass can be different designs, though that is rare.



Med venlig hilsen / Best regards / Mit freundlichen Grüßen
Christian Ræbild / Christian Raebild

Report message to a moderator

Re: h files merger? possible issues? Sat, 12 February 2011 20:40 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

In short: no double information should be in the h file after merge.

Long answer. Let's talk specific about the data that stored in the h files:
1. Short player definitions - player id, singular and plural names - stored here for each player met)
2. Ships/Starbases Designs
3. Planets Stat - owner id original/actual grav/temp/rad, concentarations, estimated population + year of the scan - stored here for each planet scanned
4. Player Scores (for your race only if no PPS enabled, and for each race in case of PPS enabled)
5. Messages filter

What merger have to do:

1. Merge race definitions (i.e. if both h1 and h2 contains definition for player X only one record will be kept, no duplicates)

2. Designs - the most tricky part.
Until design ids in the source and target h files are different the task is pretty simple, we just need to have a copy of all designs in the target file.
Once both h files have a different design with the same design id - merger have to select one of them:
* obviously if design under question belongs to one of the h file owner merger should trust to design owners
* in other cases it could always keep original design (i.e. trust to source)
* or always keep new design (i.e. trust to target)
* in more advanced scenarios it have to ask which one to prefer

3. Planets - in case of duplicated info of the same planet merger have to select one:
* obviously if planet belongs to the h file owner merger have to trust planet owners' data
* in other cases the newest scan should be kept (based on scan age stored in the h file)
* ig both scans have the same age, then simply source or target should be kept, it's almost doesn't matter

4. Player scores - the easiest part, each score have owner id and report year, there is nothing to merge, just keep one record for each player of the specific year.

5. Messages filter - shouldn't be merged at all. Should be kept unchanged.



"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Sat, 12 February 2011 20:55 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

As of testing... it looks like wumpus' tools was beta tested using rings game. And there is only one way to test it - try it and verify in a bunch of games. But once all the bugs in merger itself will be found and fixed Stars! should be OK with the resulted h file, since there is no somthing special that merger will put into h file, that Stars! doesn't.


"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Sun, 13 February 2011 07:40 Go to previous messageGo to next message
m.a@stars is currently offline m.a@stars

 
Commander

Messages: 2765
Registered: October 2004
Location: Third star to the left
XyliGUN wrote on Sat, 12 February 2011 18:16

Those, who have enough knowledge to decompile/disassemble merger.exe could also decompile stars.exe itself, so it looks like there is no additional help to cheaters in publishing merger.exe.

Stars.exe will always be harder to decompile/analize. Size matters! Sherlock



So many Stars, so few Missiles!

In space no one can hear you scheme! Deal

Report message to a moderator

Re: h files merger? possible issues? Sun, 13 February 2011 07:45 Go to previous messageGo to next message
m.a@stars is currently offline m.a@stars

 
Commander

Messages: 2765
Registered: October 2004
Location: Third star to the left
XyliGUN wrote on Sun, 13 February 2011 02:40

2. Designs - the most tricky part.
Until design ids in the source and target h files are different the task is pretty simple, we just need to have a copy of all designs in the target file.
Once both h files have a different design with the same design id - merger have to select one of them:

Do you mean that Stars! assigns different IDs for each race that meets the same design belonging to the same race? Shocked



So many Stars, so few Missiles!

In space no one can hear you scheme! Deal

Report message to a moderator

Re: h files merger? possible issues? Mon, 14 February 2011 02:42 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

m.a@stars wrote

Stars.exe will always be harder to decompile/analize. Size matters! Sherlock

Yes, it does, but I beleive merger value would be much higher for non-cheaters in team games than the risk of easier decompiling (especially there is pretty easy way to get algorithm anyway, since it's already published).

XyliGUN wrote

2. Designs - the most tricky part.
Until design ids in the source and target h files are different the task is pretty simple, we just need to have a copy of all designs in the target file.
Once both h files have a different design with the same design id - merger have to select one of them:

m.a@stars wrote

Do you mean that Stars! assigns different IDs for each race that meets the same design belonging to the same race? Shocked

Oh, no. I mean that "until source and target h files have different set of designs" - it's easy - we just a need to have a full set of designs in the resulted h file.
But source and target h files could contain different designs with the same id if this design owner has changed it after it was met\acanned by first player and before it was met\scanned by the second.



"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Mon, 14 February 2011 08:36 Go to previous messageGo to next message
m.a@stars is currently offline m.a@stars

 
Commander

Messages: 2765
Registered: October 2004
Location: Third star to the left
XyliGUN wrote on Mon, 14 February 2011 08:42

beleive merger value would be much higher for non-cheaters in team games than the risk of easier decompiling (especially there is pretty easy way to get algorithm anyway, since it's already published).

Indeed the risk wouldn't be significantly higher... Sherlock

XyliGUN wrote

source and target h files could contain different designs with the same id if this design owner has changed it after it was met\acanned by first player and before it was met\scanned by the second.

Hmm. That. Confused So you haven't found an "age of scan" for ship designs the same that exists for planets? Deal



So many Stars, so few Missiles!

In space no one can hear you scheme! Deal

Report message to a moderator

Re: h files merger? possible issues? Wed, 16 February 2011 10:04 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

m.a@stars

Hmm. That. Confused So you haven't found an "age of scan" for ship designs the same that exists for planets? Deal

Yep, AFAIK there is no such info.



"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Wed, 16 February 2011 10:08 Go to previous messageGo to next message
XyliGUN is currently offline XyliGUN

 
Ensign
Stars! V.I.P


Messages: 325
Registered: July 2004
Location: Russia, St.Petersburg

OK, let's say I'd like to publish StarsHistoryMerger.exe. Any objections? Rolling Eyes

Features:
* Merging planets stat, like concentrations, original/actual values, planet owner, starbase design (you will see the planets that you didn't yet scanned, but your teammate did)
* Merging known designs (you will see the same designs that your teammate can see including his existing designs and enemy designs known to him)
* Merging progress timelines (you will see your and your teammate progress timeline in your turn, like if PPS were enebaled for your team)

Usage:
StarsHistoryMerger.exe game.mX game.hX game.hY passwordX
where:
game.mX, game.hX - source turn m & h files
game.hY - target turn h file
passwordX - password from game.mX

What it does? It reads data from specified source (m, h) and target (h) turn files, merges it and write result into the target h file. It does verify the password provided and no data will be written if password is incorrect (so you have to know source turn password to steal the data).

It's not yet been extensivly tested, but it works well for a bunch of turns I have from my old games. If somebody wants to see merged turns, you are welcome to send me your files to merge and the password and I'll send you merged h file.


[Updated on: Wed, 16 February 2011 11:19]




"Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something."
Robert A. Heinlein, Time Enough For Love

Report message to a moderator

Re: h files merger? possible issues? Wed, 16 February 2011 11:10 Go to previous messageGo to next message
m.a@stars is currently offline m.a@stars

 
Commander

Messages: 2765
Registered: October 2004
Location: Third star to the left
XyliGUN wrote on Wed, 16 February 2011 16:08

reads data from specified source (m, h) and target (h) turn files, merges it and write result into the target h file.

Sounds like fun! Teleport

What about some parameter to exclude certain info or include just certain info, like ship designs, starbases, minefields, location of 3rd party assets, and such? Deal



So many Stars, so few Missiles!

In space no one can hear you scheme! Deal

Report message to a moderator

Re: h files merger? possible issues? Wed, 16 February 2011 13:16 Go to previous messageGo to next message
BlueTurbit

 
Lt. Commander

RIP
BlueTurbit died Oct. 20, 2011

Messages: 835
Registered: October 2002
Location: Heart of Texas
XyliGUN wrote on Wed, 16 February 2011 09:08

OK, let's say I'd like to publish StarsHistoryMerger.exe. Any objections? Rolling Eyes

I object.

Quote:

Well, I was talking to wumpus last summer..

Perhaps Wumpus is wise. And so is Ron. You however, ???

Quote:

What I'm trying to find out is if there are any resonable points to hide compiled tools from those who would really like to use them without cheating and the most important thing can someone imagine how people can cheat having h file merger?


Yes there are. As already mentioned, it would be easier for cheater to hack your file and possibly get important knowledge (did you say password?), versus having to break the Stars code to try the same. The laws of probability? The more difficult it is for everyone to get access, the more difficult it is for cheaters to get access.

Quote:

... (so you have to know source turn password to steal the data).


Steal? Freudian slip or wolf in sheep's clothing? Rolling Eyes When passwords get involved in such a tool I already have suspicions. Remind me not to play in games you are playing in. Razz

This tool would give advantages to players, that it would essentially require everyone in games to use the tool to have a fighting chance in games. Try playing against a team with this convenient merged info versus teams without the same. Try playing in a one-winner-only game where some of the weaker players pass their h-files to stronger players in exchange for favors. True, they can already pass files to be used in other utilities. But it requires much more time and work. And so is passing info on ship designs.

One of the most difficult tasks in one-winner-only games is overcoming all those weak players that tend to help the stronger to win, instead of trying to win themselves, they play as allies. etc. etc. etc.

I don't see this as an enhancement to games. I see it as another mountain to overcome in game play. But I could be wrong. Cool


[Updated on: Wed, 16 February 2011 13:24]




BlueTurbit Country/Rock

Report message to a moderator

Re: h files merger? possible issues? Wed, 16 February 2011 14:21 Go to previous messageGo to next message
m.a@stars is currently offline m.a@stars

 
Commander

Messages: 2765
Registered: October 2004
Location: Third star to the left
BlueTurbit wrote on Wed, 16 February 2011 19:16

weaker players pass their h-files to stronger players in exchange for favors.

That kind of "diplomacy" already exists. Some ppl use m-files directly. Shocked Tools could simplify the task, allowing different kinds of roles/playstyles to coexist. Deal



So many Stars, so few Missiles!

In space no one can hear you scheme! Deal

Report message to a moderator

Re: h files merger? possible issues? Wed, 16 February 2011 15:09 Go to previous messageGo to next message
donjon is currently offline donjon

 
Lt. Commander

Messages: 808
Registered: November 2002
Location: Benque Viejo del Carmen, ...

There have been games in the past which have benefited from h-files mergers. Immediately coming to my mind is the Mentored Rings game (ringsm, teams of three) and EAC vs IRC (teams of 8.)

I really think it would be inappropriate to allow an exe to be created which merges the h files. (As such, I know that if an enterprising programmer wishes to do so; they will not be deterred by a bunch of disapproving people here at the forum.)

It might be wiser to take a safer route though...

What if Wumpus gave Ron the code for the merge app. And then Ron made it available to autohost players if they wish to merge their teams histories. The accesses could then be logged and the code held in a safe place.

Would that work?

regards,
les

Report message to a moderator

Re: h files merger? possible issues? Thu, 17 February 2011 01:29 Go to previous messageGo to previous message
gible

 
Commander

Messages: 1343
Registered: November 2002
Location: Wellington, New Zealand

FWIW, my 2 cents

Thumbs Up I would approve greatly of such a merger tool, and would absolutely prefer it if a way to limit sharing could be configured...perhaps an "unmerger" tool that creates a sanitised .h file to provide to your friend for merging rather than merging the actual .h files.

Thumbsup 2 Remembering .h files need to be maintained, you can't just grab the latest .m file...and for AH at least, unless you give out your AH password only you have access to your .m file(s).

Yes While I see no need to provide a password to make this tool work with AH - the security is in the file management - I have heard rumors that people do actually play outside AH *.

Shame Regarding fears of cheaters getting the encryption via reverse engineering...it is already available to any sufficiently determined & talented cheat. Those who would oppose this tool for fear that it might be easier to extract the encryption from this tool than Stars.exe are giving up liberty in exchange for security.

Hit Computer IMO, there are already more than enough Stars! tools to discredit the "I'm disadvantaged for not using tool X" argument.

wOOt 2 Personally I would go further, and have been toying with contacting m.a.stars, Wumpus, PaulCr, LEit and anyone else who has knowledge of Stars! encryption & file formats, with the view of creating a set of libraries in a variety of programming languages to access and modify all of the files in the style of Stars! Host Editor. Done completely enough this would not only enable such tools as the above but could provide connection to alternative clients, automation tools, AIs & clones. * For a layer of security, requiring the user's game password to access files at the API level could be implemented i.e. on file open/save.

I myself have experience with Java and have worked on Stars! Autohost Client - it actually has a plugin system and some partially completed plugins for turn analysis based of the .f & .p files that were never completed.



[Updated on: Thu, 17 February 2011 01:54]

Report message to a moderator

Previous Topic: Diplomacy - honour vs credibility
Next Topic: I would like to play :)
Goto Forum:
  


Current Time: Wed Apr 24 22:10:41 EDT 2024