PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggestions

Where stuff about fanfiction that doesn't fit into any other category goes. Including Polls, RPGs & Multiple Author Works

Try to make sure that new topics here actually couldn't actually go somewhere else.

PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggestions

Postby PCHeintz72 » Mon May 19, 2014 4:13 pm

I made this mostly for corrections purposes and for a alternate downloadable listing for those interested in such.

Posting this due to PM discussion with LWF58. Should he either change his mind, or if Sunshine Temple not approve it, either I can delete the thread, or they can.

After reading the dscussion in the recent Wiki update thread, I have as a afternoon side project taken the entire Fuku fics lists wiki, downloaded it, processed it, and cleaned it up using my own Lister program

Because it was a afternoon project, it may be a bit rough around the edges, but should be relatively clean. I do not think it bad for a quick snatch and grab project.

Someone, ideally not me, could use that to clean up the Wiki itself or make suggestions for the clean up. In theory should be able to go entry by entry.

My main issues in going through the current setup link by link were:
- some fanfiction.net links were pointing to the temporary fanfiction author links (~authorname ), not the permanent one (user ID #)
- many of the direct story fan fiction links were pointing to the author pages, and the author link was going to the same page
- the wiki does not mention feed links to monitor authors
- the fanfiction.net and the archive.org links did not ever get updated to use https instead of http.

All of the above should be corrected in the attached copy.

Suggestions for wiki changes:
- allow for a preview or alpha copy link (like for Ice Squared, which has a few chapters in preview on Fukufics, and the main link which goes to the main story on FanFiction.NET)
- allow for 1 or 2 direct story links, for authors whom post it on multiple sites
- allow for 2 or 3 author links, to show multiple profile/home pages, such as Sunshine, whom has a Florestica Profile, a FanFiction.NET Profile, and a Fukufics home page.
- allow for a RSS/ATOM feed link, for those whom would like to subscribe to feeds to monitor for possible updates by author.

Limitations in my own system, or limitations due to the time constraints I placed on the project:
- The main one is I only had time to download all the stories that were on fanfiction.net and archiveofourown.org, not all the various home pages, archive.org, or miscellaneous other sites. Thus while have links for all stories I could find, only have full metadata listed for those...
- The metadata I currently have should be valid as of May 18th, 2014.
- I do not have a easy and regenerating way to track what Sailor Senshi Ranma appears as in each story as my system was not set up with that in mind. I could add it by hand, but would lose the ability to regenerate the data without losing that hand entered information. I tend to keep that stuff in my head.
- Prefix Tags are not my normal ones, but in the case of fanfiction.net and archiveofourown.org ones grabbed from the metadata. for others I followed the pattern set by the two main sites I did get metadata from.

Each list has a regular and a restricted section... Restricted links basically are the graphic level material or otherwise questionable links.

I have included everything from the project except the raw downloaded link data ripped from the wiki (I figured neither Sunshine nor lwf58 would want that made available to the general public), and the downloaded stories that I ripped the metadata from.

Because I have included the URL files, someone wanting all the links I used could easily import them into say Internet Explorer, FireFox, Opera, Avant, or some other browser with import ability.

I'm including *all* formats I output. BBCode, alternate BBCode, CSV, HTML, TXT, XML, OPML (for feed links only), all the URL files, etc... people should use whatever they feel most comfortable with, I recommend the Linked version of the file so you get all the metadata, the favorites version of the file will only have basic information.

Let me know if anyone finds this useful.

The attachment should appear here:
Attachments
FanFiction Fukufics Fuku.zip
(426.53 KiB) Downloaded 35 times
Last edited by PCHeintz72 on Mon May 26, 2014 9:56 am, edited 3 times in total.
PCHeintz72
User avatar
Prism Power Senshi
Posts: 2736
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby Sunshine Temple » Tue May 20, 2014 6:03 pm

Good ideas.

It's funny, what I'm kicking myself most for is the (~authorname ) as I thought I got rid of those.

I can see expanding the fields to have some of the wiki updates.

Though my knowledge is a bit lacking so I'm not sure how to setup a feed.

There's also the question of how much time I have. ^^;
Sunshine Temple
User avatar
Site Mistress
Posts: 2136
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby PCHeintz72 » Tue May 20, 2014 8:43 pm

Sunshine Temple wrote:Good ideas.

It's funny, what I'm kicking myself most for is the (~authorname ) as I thought I got rid of those.

I can see expanding the fields to have some of the wiki updates.

Though my knowledge is a bit lacking so I'm not sure how to setup a feed.

There's also the question of how much time I have. ^^;


Treat a feed exactly the same as a standard link.... there is generally no difference between the two functionaity wise. If clicked on a feed link in a browser, it takes to a ATOM or RSS update page. If copied to the clipboard, and placed in a feed reader such as Outlook, or Feed Demon, or Sharpreader, etc... That program can either actually monitors that link for updates, or notify you in the case of the next time it is started.

When you for example update Strained Harmony on FanFiction.NET, within a few minutes, the feed is updated on FanFiction.NET. Then the instant a Feed reader gets that feed, it in turn notifies the user there has been a change. FanFiction.NET notifies in cases of reviews, changed description, and updated chapters.

Here is your feed link for reference: https://www.fanfiction.net/atom/u/090308/

I also included an OPML file in the attachment. OPML is actually a special version of XML where you can use it to import and export as many feeds as desired in it. I included *ALL* the feeds for those authors that I was aware of, so you could import that OPML into the feed reader, and get all 111 or so feeds. Thus monitoring them all constantly and effortlessly for updates and know potentially within minutes of an update.

So... taking one of your own stories for example. In my system, it would look like:

Code: Select all
Thread Name: [Sailor Moon][Strained Harmony] by [Sunshine Temple]
Series: Sailor Moon
Prefix-Crossover: SAILORMOON-RANMA
Title-Name: 'Strained Harmony'
Author Name: Sunshine Temple
Dld Date: 04/19/2014
Dld Size: 853kb
Dld File Cnt: 4
Dld Status: In Progress
MD Source: FF.NET
MD Rating: T
MD Word Cnt: 163634
MD Summary: Chapter 4 up. this is a story of Ranma and a new job she gets... it's not exactly a manly job but that's okay it makes for a more convincing disguise. And over time Ranma comes to really love her new job... and her new ward.
Direct URL: https://www.fanfiction.net/s/3295767/1/
Author1 URL: http://florestica.com/jtemple/
Author2 URL: http://www.fukufics.com/fic/
Author3 URL: https://www.fanfiction.net/u/90308/
Feed URL: https://www.fanfiction.net/atom/u/090308/


In the wiki, it might look something like the below (note corrected direct link as well rather than double author links link in the real one as of yesterday):
Code: Select all
Summary

Ranma leaves the Tendo house until the heat from one of his “adventures” dies down. Needing money, Ranma gets a job… working for a Miss Meiou as a nanny for Hotaru.

And updated with the mostly new ch 4. Sorry for how long this took. On the upside the new chapter 5 is already written (save for the last bit of he last scene).

Other Links

Data

Type: Fuku Fic
Title: Strained Harmony
Author: Trimatter and Sunshine Temple
Status: Active
Senshi: Sailor Hestia
Content: TG
Created: 2006-12-18
Updated: 2014-04-05
Chapters: 3
Words: 162,000
Author Site Web 1: http://www.fukufics.com/fic/
Author Site Web 2: http://florestica.com/jtemple/
Fanfiction.Net Direct Link: https://www.fanfiction.net/s/3295767/1/
Fanfiction.Net Personal Profile Link: https://www.fanfiction.net/u/90308/
Fanfiction.Net Feed Link: https://www.fanfiction.net/atom/u/090308/


Hope that helps.

EDIT: as a FYI, on that entry I just pulled, noticed in passing the chapter count is also wrong, and your word count does not exactly match FF.NET, though FF.NET is notorious for being a bit off on Word Count, so uncertain which is correct.
PCHeintz72
User avatar
Prism Power Senshi
Posts: 2736
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby Sunshine Temple » Thu May 22, 2014 5:36 pm

Man, how did I goof on the chapter count of my own fic ^^;

Word count should be correct though.
Sunshine Temple
User avatar
Site Mistress
Posts: 2136
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby PCHeintz72 » Thu May 22, 2014 8:14 pm

Sunshine wrote:Man, how did I goof on the chapter count of my own fic ^^;

Word count should be correct though.

As said, I had noticed lots of little things like that. Some authors have changed ther names over the years, some stories had updates missed, there are some links to dead sites that need conversion to internet archive links, etc....

Not really a big deal.

As for mistakes in your own entries, that is actually not the only one. The Generation lost fanfiction link is broken. It is not the correct link.

It is actually going to: http://0.5.70.21/
It displays as: http://345621
It should be either https://www.fanfiction.net/u/90308/ or https://www.fanfiction.net/s/345621/1/ (depending whether wanted story or author profile link)

(or even http://florestica.com/jtemple/gl/index.htm if you wanted to point to the copy at Florestica)

My stuff may be in a bit of a different format... but it is mostly generated, not hand typed, unless FanFiction.NET and other sites are wrong (which of course can happen), as of when the list was made it *should* be correct barring me having messed up making the direct or profile link (a wrong direct link would point to wrong story, a wrong profile like would result in a wrong or mixed up author name). Thus my suggestion someone go through it entry by entry sometime and see what differences exist.

I actually do have a slightly newer generated listing, but differences would be minimal since it was generated only a day and a half later. I could delete the attachment in the first post and update if wanted, no big deal.
PCHeintz72
User avatar
Prism Power Senshi
Posts: 2736
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby Sunshine Temple » Fri May 23, 2014 9:03 pm

Ahaha.

Well least I got to fix that Gen Lost entry ^^;
Sunshine Temple
User avatar
Site Mistress
Posts: 2136
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby PCHeintz72 » Sat May 24, 2014 2:17 am

Ok...

First, I have updated the attachment in the opening post to my newest version. Only had a few tweaks, but also had a couple author links added back in.

Second, I have taken my own output, plus your own wiki, plus a couple small items, and merged them into a excel report. I attached that to this post as a zip file.

I have three sets of stories going across...
- those that have full metadata
- below those are those that have partial or no metadata
- below those are those that are lost stories

Each section ordered by author

For now I only looked through the top portion, which was by far the largest. The middle and bottom are unchecked as yet. I'll perhaps post more if I have time.

Anything highlighted in red is cases of my results differing from yours or otherwise suspect. Several authors changed names, at least one was on your site under differing names, and another was on there spelled differently.

Most links are highlighted due to either mistakes in your link, or that fanfiction.net links are not the better https version, or that you did not have the feed, or did not have a preview link, in at least once case a author had a different authors link.

Word count consistently off, not sure if that is due to FanFiction.NET being off, or you being off, a difference in format between differing sites, or author having updated a story after the fact (example, you post to FF.NET, but tend to update or tweak it as time goes on, that would alter word counts). I ignored small differences depending on size, and just highlighted them.

All of the above, is actually minor, when you factor how long this list has been in operation, in its various forms, little things like this are inevitable.

Like reviews, you are free to ignore anything you either disagree with or otherwise find faulty. It is after all your wiki, not mine. I rarely use it, but have gone into it from time to time.

EDIT: Three items of note I forgot.
- Slade merged all his separate stories into a single story archive, like Ozzallos Crapspace, or weebee and his Vault... You may want to point to individual chapters of that archive to the correct story chapters in the Wiki.

- migele lists all his sailor santa adventures separately, you seem to have them all merged, but he has more chapters than you list. I suggest turning that into a series or listing the stories separately.

- Shanami removed their story, that is true, but s/he did leave the prologue up as part of their own story archive... not sure how you may want to denote that fact, but figured I would mention it. It is the chapter 1 that is the prologue you would be looking for.
Attachments
FukuReport.zip
(26.58 KiB) Downloaded 37 times
PCHeintz72
User avatar
Prism Power Senshi
Posts: 2736
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby Té Rowan » Sat May 24, 2014 12:02 pm

PCHeintz72 wrote:...

It is actually going to: http://0.5.70.21/
It displays as: http://345621

...

The latter is actually a legal variant of the former.

345621(dec) = 00054615(hex)
00h.05h.46h.15h = 0.5.70.21
I go walking. My mind goes wandering.
Té Rowan
User avatar
Prism Power Senshi
Posts: 3015
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby Sunshine Temple » Sun May 25, 2014 6:33 pm

Thanks. Got the list. I think I might be able to get to some corrections tomorrow, but not sure.

Unfortunately I'll have to play things by ear.
Sunshine Temple
User avatar
Site Mistress
Posts: 2136
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby PCHeintz72 » Sun May 25, 2014 7:24 pm

Sunshine wrote:Thanks. Got the list. I think I might be able to get to some corrections tomorrow, but not sure.

Unfortunately I'll have to play things by ear.

I *almost* have the entire second row of stories processed (those I was until now lacking metadata or info on) I have them all downloaded now, and some metadata completed (not all metadata since most were not from sites that had it, but size, date updated, status, # files, etc for all, more for the mediaminer stories), but the dates for the immediate moment are all still set to what time downloaded today as I'm not finished processing the downloaded files.

Without access to copies of the stories, there is not really anything I can do about the 3rd row in my spreadsheet, the lost stories... With the exception of Relatively Absent I did not have them already.

I *did* correct the links for 'Dragon and the Phoenix' by Figure Four in my stuff, the initial archive org links I set them to, while correct, did not properly take you to chapters (archive.org links as I'm sure you are aware are iffy, some days work, some days don't), so found alternate links that did.

I also refreshed my list, since the original start of the project one fukufic actually updated. Should be current as of this morning.

When I finish the 2nd row, I'll update the zip file again, since it will have much more information on about 45 stories, which are the ones downloaded from all over the place, plus the corrections. And see about updating the report spreadsheet, which has to be by hand as that was not generated by any system of mine but made custom for your use....
PCHeintz72
User avatar
Prism Power Senshi
Posts: 2736
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby Spica75 » Sun May 25, 2014 8:52 pm

Word count consistently off, not sure if that is due to FanFiction.NET being off, or you being off, a difference in format between differing sites, or author having updated a story after the fact (example, you post to FF.NET, but tend to update or tweak it as time goes on, that would alter word counts). I ignored small differences depending on size, and just highlighted them.


Exact word count being off seems to be par for the course, just about everywhere.
There are for example some stories posted on both FFN, tth, and other places, and despite being 100% identical in how the story looks, wordcount can be completely different in all places. And if i copy/paste into the programs i use myself, the wordcount by them are not the same either.

So just about anything is possible. Probably just use what seems the most correct you can find.
Spica75
User avatar
Prism Power Senshi
Posts: 2399
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby PCHeintz72 » Mon May 26, 2014 3:18 am

Ok... I think I've taken it about as far as I can with everything short of having the Lost stories. Or putting a lot more effort in than I'm willing to so as to manually make metadata for all those stories that did not come from ArchiveOfOurOwn.ORG, or FanFiction.NET, or MediaMiner.ORG.

1. I updated the opening post with the latest build of the project. This accounts for that whole selection of stories downloaded from old sites.

2. The report has been updated, I'm attaching it to this post.

3. A couple other things done...
- I put new links for yasuhei... the old anifics internet archive were not bringing up the complete chapters, the current ones do. Which means that story is not lost to you anymore.
- I used my own copy of 'Relatively Absent' by Togashi Gaijin to figure out chapter counts and dates... I also noted and split out the two side stories I'm aware of for that story (I had always wished that one had been continued).
- Because I actually had a copy of 'Relatively Absent' by Togashi Gaijin, it displays with the rest of the stories, not with the lost stories, but denotes the direct link as a invalid one. That *may* be a bit confusing, but it makes sense in my system as I normally do not refer to stories I do not have... Thus why need the 'lost' section in the first place as a kludge to get my system to show them.
- I changed the link slightly for the 'Waking Up With Curves' story, the second time I did so, the first was to update it... the new one however specifically targets and displays only the relevant episodes on that adventure site, at least until new ones added.
- I changed the link to 'Ranko's Bet The Silent Master' by migele by migele to point to the copy on his old home page, that copy has a couple scenes at the end that is not in the MediaMiner.ORG copy.
- I changed 'Polarity' by Tirsis to go to FanFiction.NET, not MediaMiner.ORG, not sure why I used the MediaMiner.ORG link originally, but I prefer the FanFiction.NET links especially due to MediaMiner.ORG being partially broke at the moment..

Let me know if issues.
Attachments
FukuReport.zip
(27.67 KiB) Downloaded 35 times
PCHeintz72
User avatar
Prism Power Senshi
Posts: 2736
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby Sunshine Temple » Wed May 28, 2014 9:40 pm

Minor status.

I haven't been able to get to the file yet. Apologies for the continued delays on my part.

(On somehwat related news, ch33 of Return is written up at least).
Sunshine Temple
User avatar
Site Mistress
Posts: 2136
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby PCHeintz72 » Thu May 29, 2014 12:48 am

Your delay I expected... after all, I only worked on this as I had free time myself, Since I do not do my normal posting at this time of year, I had a bit more than normal. But I have not had much free time myself these last couple days. I figured I would not even hear of anything from you until this coming weekend. Besides, it is not like I issued a single individual correction or two.

What does surprise me, is I figured this entire new section would have been swarming with people upon its creation issuing corrections/updates/additions/etc. Especially considering the near uproar it was creating in the thread that prompted its creation in the first place. That was after all what prompted me to grab it and see what could be done with it with somewhat minimal effort, considering it is a couple hundred stories, and a few hundred links... it is not exactly a small thing to check it all.

In any case, hopefully it will help at least somewhat, the main listing and the report.

FYI... Tentatively, I plan on creating a few threads on June 1st here on Fukufics, with attachments, I've currently done somewhat similar processing of the following forum threads that I did for the Fukufics Wiki that I thought some here might be interested in:

Fukufics Forum General Update thread (both the old read only and current threads in one list)
TFF Forum Akumatsu Recommendation threads (2 Love Hina and 2 Negima threads in one list)
TFF Forum General recommendations thread
TFF Forum NGE recommendations thread
TFF Forum Ranma recommendations thread

I did cut some corners on the above compared to my own lists, mostly in regards to the stories not on a site with easily obtained metadata that I did not already have. But the links that are there work...

My own listing may or may not be ready for a full release again... I've only had time to check part of it, I normally check all of it.

It was interesting seeing the differences in recommendations, and the differences in bit rot...
PCHeintz72
User avatar
Prism Power Senshi
Posts: 2736
 

Re: PCHeintz72 Downloadable Fuku-Fics Listings/Wiki Suggesti

Postby Sunshine Temple » Thu Jul 10, 2014 7:52 pm

Well... bad news. I haven't had much of a chance to do wiki stuff.

Good news... I've got three chapters that I've got in alpha (Okay the Return chatper is almost written).

I'm hoping things can ease up in a bit.
Sunshine Temple
User avatar
Site Mistress
Posts: 2136
 

Next

Return to Miscellaneous, Polls, RPGs

Who is online

Users browsing this forum: No registered users