Loading. Please Wait...
|
|
|
[Script (python)] Auction Parser 1.2 Script to find highest bids in an auction thread, For HV auctioneers |
|
Mar 27 2022, 14:21
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
Most recent version for Persistent Item auction:
HVauction1.2.txt ( 25.18k )
Number of downloads: 36 Most recent version for Isekai Equipment auction:
HVauction_equip1.1.txt ( 28.67k )
Number of downloads: 9Requires Python 3 to run. In line 201, change the URL to the URL of your auction CODE parser.add_argument('--url', default='https://forums.ehentaihip.com/index.php?showtopic=259009',
Thanks to what_is_name for creating the isekai equipment auction script _____________________________________________________________________________________________________ I would like to find the highest bids from all posts, so I can create a central post with all highest bids. Minimal Viable ProductWhat would help a lot already is a script collecting any text looking like [Name] 100k or [name] 1.2m from a specific thread and putting them under each other in a pop up window, sorted by [name] Status: COMPLETE (see 1st upgraded product) Thanks to GREGRE! 1st upgraded productThen building from there, it would be great if I could automatically see: [Auction item name] [highest bid] [Name who posted that bid] Status: COMPLETE (see final product) Thanks to firew! final productAnd then Extremely Excellent it would be if I could automatically see: [Auction item name] [highest bid] [Name who posted that bid] [price per item] Features - next to primary function of finding highest bid + bidder + price-per-item in a HV forum thread: 1. exclude auctioneer's posts (replace with your username in first part of the code) 2. exclude first posts up to a specified number of posts or determine when the bidding starts based on timer 3. show current bid + next bid, each with price-per-item Status: COMPLETE (see final product) Thanks to Ass Spanker, and what_is_name!!
HVauction1.2.txt ( 25.18k )
Number of downloads: 36 Fix some minor stuff, clean up some minor stuff, add the post stuff. How-to is inside the script. Some quick stuff to take note of: - If necessary, add items to ITEM_CATEGORIES. Format can copy from existing entries, item names should be in lower case with dash "-" replaced by 1 space " ". - I use a lot of item categories to add more granular control to groupings. For custom item groupings, make changes accordingly to CATEGORY_GROUPINGS. - There's no smart or ML-powered matching, so the responsibility falls on item posters to make sure item names are correct (Low-Grade Metals instead of LowGrade Metal, something like that). This post has been edited by Noni: Jul 3 2022, 19:10
--------------------
|
|
|
|
|
|
Mar 28 2022, 01:17
|
GREGRE
Group: Gold Star Club
Posts: 156
Joined: 27-November 10
|
Here's a first cut at this in Python. There are some corner cases (starting bids are assumed to always be overridden by any subsequent bid, and it assumes each bid is associated with a price and nothing else), but it does seem to work. Thanks to Tenrag/firew for the help.
hv_auction_parse.txt ( 4.86k )
Number of downloads: 41edit: Made a number of improvements and overhauled parsing.
hv_auction_parse_v2.0.0.txt ( 5.46k )
Number of downloads: 9This post has been edited by GREGRE: May 12 2022, 22:13
|
|
|
|
|
|
Mar 28 2022, 21:06
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
QUOTE(GREGRE @ Mar 28 2022, 01:17) Here's a first cut at this in Python. There are some corner cases (starting bids are assumed to always be overridden by any subsequent bid, and it assumes each bid is associated with a price and nothing else), but it does seem to work. Thanks to Tenrag/firew for the help.
hv_auction_parse.txt ( 4.86k )
Number of downloads: 41Excellent!! Works perfectly. I need to change the forum thread in the code (the 'default'), though. Can't figure out how to get the right URL otherwise. But that's not a big deal, easily fixed! Small problem is that we can't exclude the 'original poster' in my set-up, because everyone can add their own auction so we have a lot of original posters. And they can also bid on items from other people as well. But I can solve that by deleting those lines from the output manually before posting on the forum. By the way, this script can be used by anyone who creates an auction on Isekai forum as well!
--------------------
|
|
|
|
|
|
Mar 29 2022, 08:42
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
I made a slight modification for my auction specifically. There is a variable now 'lastautionpostnr', and in the beginning I can set that to the number of the last auction posts. After that post, the bidding starts. And the script ignores any posts up to that post number.
hv_auction_parse_1.txt ( 4.99k )
Number of downloads: 22This post has been edited by Noni: Mar 29 2022, 08:46
--------------------
|
|
|
|
|
|
Mar 31 2022, 20:31
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
newest version with Noni's and firew's corrections:
hv_auction_parse_3.txt ( 5.18k )
Number of downloads: 44This post has been edited by Noni: Apr 1 2022, 09:37
--------------------
|
|
|
|
|
|
Apr 9 2022, 00:33
|
Ass Spanker
Group: Gold Star Club
Posts: 3,797
Joined: 25-July 12
|
The printing is goddamn messy but I don't want to rewrite codes not by me too much. Added the price per item thing, item listing with quantity and price, an option to automatically parse the bidding post time from the countdown timer so that it's not necessary to manually put lastautionpostnr in every time, though it's still possible by setting --ignored_posts argument to any number and not None.
hvauction.txt ( 9.75k )
Number of downloads: 20Posts #7 and #8 of auction #2 were posted before Thu 1400 UTC so the countdown parsing thing wouldn't work unless you change the timer to expire a bit earlier so that those 2 posts fall outside the no bidding time, then you can see the feature in its glory. This post has been edited by Ass Spanker: Apr 9 2022, 00:41
--------------------
QUOTE helo my england not so good but i make translate anyway with ocr deepl from chinese to england please give to me comison donate to kofi thank
____ Weapons: Shield _ | Rapier: Light - Dark | _____ Staff 1H Slaughter: Head ___ | Body ___ | Hands ___ | Legs | Feet _Frozen Mage: Head [2] | Body ___ | Hands ___ | Legs | Feet === === === === === === === === === === === === === === === *bork me karma* | MPC-HC foobar master race. Fite me. | # of Chaos Token to unlock slots
Orbital Friendship Cannon crits Viserion for 2232753 void damage Battle Perks: Vigorous Vitality, Effluent Ether, Resplendent Regeneration, Eminent Elementalist, Evil Enchantress, Force of Nature, Enigma Energizer, Dæmon Duality III, Innate Arcana V Misc Perks: Coupon Clipper, Extra Strength Formula, Crystarium V, Tokenizer III, Hoarder I, Long Gone Before Daylight, Postage Paid
|
|
|
|
|
|
Apr 9 2022, 08:20
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
QUOTE(Ass Spanker @ Apr 9 2022, 00:33) The printing is goddamn messy but I don't want to rewrite codes not by me too much. Added the price per item thing, item listing with quantity and price, an option to automatically parse the bidding post time from the countdown timer so that it's not necessary to manually put lastautionpostnr in every time, though it's still possible by setting --ignored_posts argument to any number and not None.
hvauction.txt ( 9.75k )
Number of downloads: 20Posts #7 and #8 of auction #2 were posted before Thu 1400 UTC so the countdown parsing thing wouldn't work unless you change the timer to expire a bit earlier so that those 2 posts fall outside the no bidding time, then you can see the feature in its glory.
--------------------
|
|
|
|
|
|
Apr 10 2022, 12:01
|
what_is_name
Group: Gold Star Club
Posts: 550
Joined: 5-May 19
|
Add more goddamn messy printings
hvauction.txt ( 11.33k )
Number of downloads: 19This post has been edited by what_is_name: Apr 10 2022, 12:14
|
|
|
|
|
|
Apr 10 2022, 15:06
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
QUOTE(what_is_name @ Apr 10 2022, 12:01) Add more goddamn messy printings
hvauction.txt ( 11.33k )
Number of downloads: 19thanks! Nice! CODE Current Bid List: Sun Apr 10 15:03:02 2022 item_key item current_bid next_price ------------------------------------------------------------------------------------------------------------------------ noni01 25x sapling wscore 213k(8.5k/mat) 218k(8.7k/mat) noni02 80x Lock of Blue Hair wscore 176k(2.2k/mat) 181k(2.3k/mat) noni03 200x SG trophies wscore 840k(4.2k/mat) 845k(4.2k/mat) snom01 20x Black Knife Armor Pieces / Black Tea Shirt - 190k(9.5k/mat) snom02 50x Erd Tree Sapling - 500k(10.0k/mat) mathl33t01 17x Noodly Appendage wscore 595k(35.0k/mat) 600k(35.3k/mat) eff02 750x T3 Trophies - 3900k(5.2k/mat) noni04 10x Energy Drink cornandbeans 995k(99.5k/mat) 1000k(100.0k/mat) mathl33t03 10000x Mana Draught - 20k(2.0c/mat) noni05 300x high-grade cloth wscore 3000k(10.0k/mat) 3005k(10.0k/mat) noni06 500x high-grade wood wscore 1000k(2.0k/mat) 1005k(2.0k/mat) mathl33t04 500x Low-Grade Metal mxy215 6k(12.0c/mat) 11k(22.0c/mat) mysteryseeker01 400x Crystal Pack Basara Nekki 7400k(18.5k/mat) 7405k(18.5k/mat) scum01 2x Platinum Coupon zen_zen 1000k(500.0k/mat) 1005k(502.5k/mat) scum02 2x Gold Coupon - 400k(200.0k/mat) scum03 4x Silver Coupon - 80k(20.0k/mat) mathl33t02 1x Vinyl Scratch Figurine amaimono 12k(12.0k/mat) 17k(17.0k/mat) mathl33t05 100x Aether Shard lololo16 240k(2.4k/mat) 245k(2.5k/mat) eff01 50x Precursor Artifact - 1100k(22.0k/mat)
--------------------
|
|
|
|
|
|
Apr 14 2022, 21:38
|
Ass Spanker
Group: Gold Star Club
Posts: 3,797
Joined: 25-July 12
|
hvauction.txt ( 25.13k )
Number of downloads: 16 Fix some minor stuff, clean up some minor stuff, add the post stuff. How-to is inside the script. Some quick stuff to take note of: - If necessary, add items to ITEM_CATEGORIES. Format can copy from existing entries, item names should be in lower case with dash "-" replaced by 1 space " ". - I use a lot of item categories to add more granular control to groupings. For custom item groupings, make changes accordingly to CATEGORY_GROUPINGS. - There's no smart or ML-powered matching, so the responsibility falls on item posters to make sure item names are correct (Low-Grade Metals instead of LowGrade Metal, something like that). CODE [size=2][b]Bindings & Mats[/b][/size] [noni03] 10 binding of destruction (start: 400k) [noni05] 4 Crystallized Phazon (start: 1200k)
[size=2][b]Consumables[/b][/size] [monos03] 2 Energy Drink (start: 220k) [raraha01] 50 Energy Drink (start: 5000k)
[size=2][b]Trophies[/b][/size] [noni01] 300 Schoolgirl Trophies (start: 1200k) [list] [*]100 Bunny Girl Costume [*]100 Hinamatsuri Doll [*]100 Broken Glasses [/list] [noni02] 10 Noodly Appendage (start: 300k) [monos01] 40 Precursor Artifact (start: 960k) [monos02] 15 Noodly Appendage (start: 670k) [szuhra01] 100 Holy Hand Grenade of Antioch (start: 200k) [szuhra02] 100 Dalek Voicebox (start: 200k) [szuhra03] 250 Lock of Blue Hair (start: 500k) [szuhra04] 750 SG Trophies (start: 3000k) [list] [*]250 Bunny-Girl Costume [*]250 Hinamatsuri Doll [*]250 Broken Glasses [/list]
===================================================================== Current Bid List: Thu Apr 14 21:38:06 2022 item_key item current_bid next_price ------------------------------------------------------------------------------------------------------------------------ noni01 300x Schoolgirl Trophies - 1200k(4.0k/mat) noni02 10x Noodly Appendage mundomuñeca 300k(30.0k/mat) 305k(30.5k/mat) monos01 40x Precursor Artifact - 960k(24.0k/mat) monos02 15x Noodly Appendage - 670k(44.7k/mat) szuhra01 100x Holy Hand Grenade of Antioch - 200k(2.0k/mat) szuhra02 100x Dalek Voicebox - 200k(2.0k/mat) szuhra03 250x Lock of Blue Hair - 500k(2.0k/mat) szuhra04 750x SG Trophies - 3000k(4.0k/mat) noni03 10x binding of destruction mundomuñeca 400k(40.0k/mat) 405k(40.5k/mat) noni05 4x Crystallized Phazon - 1200k(300.0k/mat) monos03 2x Energy Drink - 220k(110.0k/mat) raraha01 50x Energy Drink sparroff 5000k(100.0k/mat) 5005k(100.1k/mat)
QUOTE Bindings & Mats[noni03] 10 binding of destruction (start: 400k) [noni05] 4 Crystallized Phazon (start: 1200k) Consumables[monos03] 2 Energy Drink (start: 220k) [raraha01] 50 Energy Drink (start: 5000k) Trophies[noni01] 300 Schoolgirl Trophies (start: 1200k) - 100 Bunny Girl Costume
- 100 Hinamatsuri Doll
- 100 Broken Glasses
[noni02] 10 Noodly Appendage (start: 300k) [monos01] 40 Precursor Artifact (start: 960k) [monos02] 15 Noodly Appendage (start: 670k) [szuhra01] 100 Holy Hand Grenade of Antioch (start: 200k) [szuhra02] 100 Dalek Voicebox (start: 200k) [szuhra03] 250 Lock of Blue Hair (start: 500k) [szuhra04] 750 SG Trophies (start: 3000k) - 250 Bunny-Girl Costume
- 250 Hinamatsuri Doll
- 250 Broken Glasses
This post has been edited by Ass Spanker: Apr 14 2022, 21:43
--------------------
QUOTE helo my england not so good but i make translate anyway with ocr deepl from chinese to england please give to me comison donate to kofi thank
____ Weapons: Shield _ | Rapier: Light - Dark | _____ Staff 1H Slaughter: Head ___ | Body ___ | Hands ___ | Legs | Feet _Frozen Mage: Head [2] | Body ___ | Hands ___ | Legs | Feet === === === === === === === === === === === === === === === *bork me karma* | MPC-HC foobar master race. Fite me. | # of Chaos Token to unlock slots
Orbital Friendship Cannon crits Viserion for 2232753 void damage Battle Perks: Vigorous Vitality, Effluent Ether, Resplendent Regeneration, Eminent Elementalist, Evil Enchantress, Force of Nature, Enigma Energizer, Dæmon Duality III, Innate Arcana V Misc Perks: Coupon Clipper, Extra Strength Formula, Crystarium V, Tokenizer III, Hoarder I, Long Gone Before Daylight, Postage Paid
|
|
|
|
|
|
Apr 15 2022, 14:06
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
HVauction1.2.txt ( 25.18k )
Number of downloads: 36 Small update: in previous version by Ass Spanker, multiple start bids do get a warning but the newest start bidder shows as winner. I changed it so that only if the winner is None it will update the winner name for start bids. This post has been edited by Noni: Apr 15 2022, 14:07
--------------------
|
|
|
Apr 23 2022, 09:30
|
what_is_name
Group: Gold Star Club
Posts: 550
Joined: 5-May 19
|
removed
This post has been edited by what_is_name: Jun 19 2022, 17:23
|
|
|
|
|
|
Apr 23 2022, 09:39
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
QUOTE(what_is_name @ Apr 23 2022, 09:30) [attachmentid=163138] update: - fix some timestamp convert and the unicode print out encoding - add auto update feature usage: - normally run the script it will work the same as before - to use auto update: 1. get your cookie: open a logined forums page and run the follow code in the console CODE var a = document.createElement('a');a.href = URL.createObjectURL(new Blob([document.cookie.match(/ipb_member_id=\d+; ipb_pass_hash=[0-9a-z]{32}/)]));a.download='cookie.txt';document.body.appendChild(a);a.click() it will download a cookie.txt file which contains your login info 2. move the cookie.txt file to the same folder where the script is 3. run the script then it will update the result to the target floor (default to floor 2) Cautions:1. don't share your cookie file and carefully store it 2. the target floor shouldn't contains other useful info otherwise it will be override by the running result hmmm.... with mod rights, this could get messy if I accidentally select the wrong post - my account can edit any thread. The time it takes to copy/paste is so small, I think I'll not be using the auto-update function also, I get an error: CODE Traceback (most recent call last): File "C:/Python310/HVauction1.3.py", line 16, in <module> sys.stdout = io.TextIOWrapper(sys.stdout.buffer,encoding='utf-8') AttributeError: 'StdOutputFile' object has no attribute 'buffer'
another bug: bids below the start bid are accepted by the script This post has been edited by Noni: Apr 23 2022, 12:00
--------------------
|
|
|
|
|
|
Apr 23 2022, 12:03
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
bug fix: bids lower than start are now not accepted:
HVauction1.2.1.txt ( 25.33k )
Number of downloads: 6This post has been edited by Noni: Apr 23 2022, 12:10
--------------------
|
|
|
Apr 23 2022, 19:03
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
another bug fix: 1. no start bid, then stat bid is 5.0k not 0.0k 2. min bid increment of 5k is now checked when deciding if the bid wins
HVauction1.2.2.txt ( 25.33k )
Number of downloads: 6This post has been edited by Noni: Apr 24 2022, 08:44
--------------------
|
|
|
|
|
|
Jun 19 2022, 09:31
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
I created a version for Isekai Equipment auction:
HVauction_isk1.2.2.txt ( 25.21k )
Number of downloads: 6Doesn't work perfectly yet, but it's a functional Minimum Viable Product What needs to be fixed: Priority 1. 1. Find a way to include clickable links in the auction posts, and get them into the central auction list: Option 1.1. post equipment as clickable link in item_name and the script is able to handle that in the auction output. Now, the url will break the script unless it's in the sub-bullets as listed item Option 1.2.Post the url in a sub-bullet oft [list]. Now, even in sub-bullet listed item, the script doesn't handle the URL correctly, and it will give a messed up link as output. My current work-around is to make users post a non-clickable link, without the https://. But an updated version of this script should be able to handle links. Priority 2. 2.1 Equipment sorting. The current script is built for items, not for equipment. Hence, it will look for item names and put anything other than that into one unsorted category. Script should be able so recognize if it's a 1h weapon, shield, heavy armor etc. and put it into those categories in the main auction Lowest priority 3.1 make lay-out of auction items similar to Super's. Really not needed if it's hard to fix, the auction will work fine without this. Any help would be greatly appreciated! This post has been edited by Noni: Jun 19 2022, 17:06
--------------------
|
|
|
|
|
|
Jun 19 2022, 17:43
|
what_is_name
Group: Gold Star Club
Posts: 550
Joined: 5-May 19
|
well some update base on 1.2.2: 1. +EQUIPMENT_CATEGORIES 2. support to parse [url] [b] [color] bbcode in entry list now (other formats will be deleted) 3. current bid now add into the generated bbcode list - the price-per-item table is now unused ( still work if you uncomment it but it looks shit with bbcode in it) 4. add start and increase price arguments for easier change setup 5. floor 1 and 2 now ignored no other change in parse bid part and theoretically it still support the normal items, not tested althought. output sample: CODE [size=2][b]Light Armor[/b][/size] [light1] [url=https://hentaiverse.org/equip/225594616/ac2b3f66bd]Magnificent Shade Gauntlets of the Arcanist[/url] (361, Evd 3%, ADB 19%) (current: winner 1234k)
[size=2][b]One-Handed[/b][/size] [one01] [url=https://hentaiverse.org/equip/213458190/aa1e6144b7]Magnificent Rapier of Slaughter[/url] (317) (start: 50k) [one02] [url=https://hentaiverse.org/equip/216763825/8bb2d3bb5c]Magnificent Rapier of the Nimble[/url] (336, ADB 1%) (start: 50k) [one03] [url=https://hentaiverse.org/equip/258528515/531997c353][b]Legendary[/b] Arctic Axe of [color=red]Slaughter[/color][/url] (379, ADB 7%) (current: abc 50.0k)
[size=2][b]Trophies[/b][/size] [item1] 22915 test (current: abc 50k(2.2c/mat)k) [list] [*] 250 Bunny-Girl Costume [*] 250 Hinamatsuri Doll [*] 250 Broken Glasses [/list]
[size=2][b]Two-Handed[/b][/size] [two02] [url=https://hentaiverse.org/equip/281745139/b030615de7]Legendary Demonic Mace of Slaughter[/url] (494, ADB 40%) (start: 50k)
old 1.3 removed as it unused and in order not to crush the later version name, you may want to test it and rename as needed althought I still think this script is not that useful, even for myself who can update it, I'm too lazy to run it to check the current bid
hvauction_equipment_support.txt ( 28.02k )
Number of downloads: 5This post has been edited by what_is_name: Jun 19 2022, 18:09
|
|
|
|
|
|
Jun 19 2022, 18:40
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
Thanks so much for your script! I'm testing now: CODE Traceback (most recent call last): File "C:/Users/**/AppData/Local/Programs/Python/Python310/HVauction_equip.py", line 15, in <module> sys.stdout = io.TextIOWrapper(sys.stdout.buffer,encoding='utf-8') AttributeError: 'StdOutputFile' object has no attribute 'buffer'
I guess that has to do with the formatting? edit: if I just put # before line 15 the script works This post has been edited by Noni: Jun 19 2022, 19:07
--------------------
|
|
|
|
|
|
Jun 19 2022, 18:56
|
what_is_name
Group: Gold Star Club
Posts: 550
Joined: 5-May 19
|
QUOTE(Noni @ Jun 20 2022, 00:40) Thanks so much for your script! I'm testing now: CODE Traceback (most recent call last): File "C:/Users/**/AppData/Local/Programs/Python/Python310/HVauction_equip.py", line 15, in <module> sys.stdout = io.TextIOWrapper(sys.stdout.buffer,encoding='utf-8') AttributeError: 'StdOutputFile' object has no attribute 'buffer'
I guess that has to do with the formatting? emm, don't know why but maybe you can delete that line. I add it because some unicode username printout mess because the system encoding, but base on your previous auction I guess it work OK in your system without this line ================== QUOTE 5. floor 1 and 2 now ignored
edit: to be clear, floor 1 and 2 now ignored means the script won't read floor 1 and 2 as the auction entrys, so the auction entry should post after floor 2, but you should edit the output to the floor 1 or 2. That's because the current bid price now added to the generated lists and the script can't correctly parse the list with a current bid, if you put the output in floor 3 then the current bid will be considered as a decription and every time you run it will add a new current bid after it This post has been edited by what_is_name: Jun 19 2022, 19:13
|
|
|
|
|
|
Jun 19 2022, 19:16
|
Noni
Group: Catgirl Camarilla
Posts: 10,732
Joined: 19-February 16
|
QUOTE(what_is_name @ Jun 19 2022, 18:56) emm, don't know why but maybe you can delete that line. I add it because some unicode username printout mess because the system encoding, but base on your previous auction I guess it work OK in your system without this line
==================
edit: to be clear, floor 1 and 2 now ignored means the script won't read floor 1 and 2 as the auction entrys, so the auction entry should post after floor 2, but you should edit the output to the floor 1 or 2. That's because the current bid price now added to the generated lists and the script can't correctly parse the list with a current bid, if you put the output in floor 3 then the current bid will be considered as a decription and every time you run it will add a new current bid after it
ok that line is deleted. But now I'm testing, I can't outbid any existing bids? Edit: solved it. The increase argument was default at 10000 but that is handled as if it was in k. So default should be 10. works perfectly now! This post has been edited by Noni: Jun 19 2022, 19:21
--------------------
|
|
|
|
|
|
2 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
|
|
|
|
|
|
|